-- Logs begin at Tue 2022-08-23 15:30:20 UTC, end at Tue 2022-08-23 17:01:10 UTC. -- Aug 23 16:24:08.591459 dv-osbrick-836057-5-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 16:24:08.603913 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 16:24:08.606696 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 16:24:08 2022] *** Aug 23 16:24:08.606696 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 16:24:08.606696 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 16:24:08.606696 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: nodename: dv-osbrick-836057-5-ceph Aug 23 16:24:08.606696 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: machine: x86_64 Aug 23 16:24:08.606696 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: clock source: unix Aug 23 16:24:08.606696 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: pcre jit disabled Aug 23 16:24:08.606696 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: detected number of CPU cores: 4 Aug 23 16:24:08.606696 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: current working directory: / Aug 23 16:24:08.606696 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: detected binary path: /usr/bin/uwsgi-core Aug 23 16:24:08.607797 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: your processes number limit is 47680 Aug 23 16:24:08.607797 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: your memory page size is 4096 bytes Aug 23 16:24:08.607797 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: detected max file descriptor number: 2048 Aug 23 16:24:08.607797 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: lock engine: pthread robust mutexes Aug 23 16:24:08.607797 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: thunder lock: enabled Aug 23 16:24:08.607797 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 16:24:08.607797 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 16:24:08.654162 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: Python main interpreter initialized at 0x563b8fc3e9c0 Aug 23 16:24:08.654162 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: python threads support enabled Aug 23 16:24:08.654162 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: your server socket listen backlog is limited to 100 connections Aug 23 16:24:08.654162 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: your mercy for graceful operations on workers is 90 seconds Aug 23 16:24:08.654716 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 16:24:08.654716 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: *** Operational MODE: preforking *** Aug 23 16:24:08.659871 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: *** uWSGI is running in multiple interpreter mode *** Aug 23 16:24:08.659871 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: spawned uWSGI master process (pid: 88338) Aug 23 16:24:08.659871 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: spawned uWSGI worker 1 (pid: 88348, cores: 1) Aug 23 16:24:08.659871 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: spawned uWSGI worker 2 (pid: 88349, cores: 1) Aug 23 16:24:08.659871 dv-osbrick-836057-5-ceph devstack@keystone.service[88338]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 16:24:08.655097 dv-osbrick-836057-5-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 23 16:24:13.515969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:24:13.515969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: from cryptography.utils import int_from_bytes Aug 23 16:24:13.517242 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:24:13.517242 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: from cryptography.utils import int_from_bytes Aug 23 16:24:13.532230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:24:13.532230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: from cryptography.utils import int_from_bytes Aug 23 16:24:13.533183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:24:13.533183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: from cryptography.utils import int_from_bytes Aug 23 16:24:13.568216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 16:24:13.568491 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 16:24:13.568693 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] command line args: [] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 16:24:13.569030 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 16:24:13.569267 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ================================================================================ {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 16:24:13.569583 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] admin_token = **** {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.569890 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] config_dir = [] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.570135 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.570378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] config_source = [] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.570617 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] debug = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.570888 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.571623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.571821 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.572167 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.572586 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.572991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] list_limit = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.573305 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] log_config_append = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.573614 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.573939 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] log_dir = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.574224 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] log_file = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.574600 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.575058 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.575429 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.575787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.576054 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.576311 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.576661 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.577005 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.577339 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.577675 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.578018 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.578356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.578705 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.579088 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.579557 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.580179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.580379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] publish_errors = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.580676 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.580970 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.581190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.581498 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.581771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.582044 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] standard_threads = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.582316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.582517 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 16:24:13.582704 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.582891 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 16:24:13.583076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.583303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] command line args: [] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 16:24:13.583510 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] use_journal = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.583717 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 16:24:13.583717 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ================================================================================ {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 16:24:13.584082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] use_json = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.584082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] use_stderr = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.584435 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] admin_token = **** {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.584435 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] config_dir = [] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.584789 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] use_syslog = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.584969 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.585153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.585336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] config_source = [] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.585336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] debug = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.585706 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.585890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.586122 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.586308 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.586308 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.586680 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.586866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.587060 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.587270 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.587270 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] list_limit = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.587632 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.587838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] log_config_append = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.587838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.588186 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.588378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] log_dir = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.588570 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.588758 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] log_file = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.588758 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.589196 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.589379 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.589596 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.589792 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.589998 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.590178 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.590178 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.590522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.590696 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.590696 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.591029 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.591190 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.591399 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.591565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.591737 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.591916 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.592084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.592250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.592250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.592564 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.592729 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.592921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.593105 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.593280 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.593467 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.593658 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.593856 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.594159 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.594344 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] publish_errors = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.594540 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.594734 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.594734 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.595112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.595336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.595336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.595673 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.595851 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.595851 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] standard_threads = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.596217 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.596405 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.596405 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.596768 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.596962 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.596962 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] use_journal = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.597327 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.597506 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] use_json = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.597506 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] use_stderr = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.597506 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] use_syslog = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.598056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.598259 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:24:13.598462 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.598655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.598655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.599007 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.599202 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.599202 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.599629 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.599832 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.600011 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.600191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.600191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.600537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.600721 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.600902 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.601077 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.601077 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.601437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.601621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.601621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.601953 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.602128 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.602317 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.602609 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.602609 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.602965 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.603141 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.603345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.603541 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.603541 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.603905 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.604082 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.604267 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.604455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.604455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.604821 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.605010 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.605193 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.605371 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.605547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.605737 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.605924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.606113 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.606802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.606985 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.606985 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.607380 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.607592 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.607771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.607955 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.608132 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.608321 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.608321 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.608683 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.608866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.609049 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.609298 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.609298 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.609656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.609860 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.610051 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.610228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.610410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.610597 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.610784 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.610988 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.610988 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.611360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.611546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.611733 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.611938 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.612124 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.612323 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.612507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.612688 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.612688 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.613040 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.613226 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.613425 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.613608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.613790 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.613983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.613983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.614331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.614331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.614688 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.614897 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.615100 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.615100 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.615513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.615714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.615903 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.616088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.616276 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.616476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.616476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.616837 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.617025 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.617209 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.617477 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.617658 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.617851 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.617851 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.618218 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.618407 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.618591 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.618772 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.618960 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.619176 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.619176 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.619611 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.619810 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.620001 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.620186 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.620386 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.620571 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.620753 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.620937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.621126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.621312 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.621312 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.621772 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.622504 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.622704 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.622889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.623074 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.623306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.623306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.623659 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.623843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.624041 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.624238 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.624424 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.624621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.624798 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.624984 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.624984 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.625349 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.625551 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.625798 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.625996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.626194 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.626390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.626390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.626756 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.626940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.627114 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.627388 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.627570 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.627748 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.627948 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.628148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.628148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.628497 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.628754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.628942 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.629129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.629326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.629512 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.629696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.629877 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.629877 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.630246 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.630445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.630631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.630812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.630994 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.631171 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.631171 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.631563 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.631750 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.631933 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.632114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.632306 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.632490 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.632490 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.632857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.633038 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.633230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.633416 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.633634 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] auth.external = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.633838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.634026 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.634210 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.634210 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] auth.external = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.634548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.634745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.634982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.635182 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.635442 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] auth.password = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.635641 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.635641 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] auth.password = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.635986 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] auth.token = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.636186 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] auth.token = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.636382 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.636581 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.636765 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.636954 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.636954 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.637297 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.637478 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.637685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.637873 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.638062 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.638248 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.638248 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.638600 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.638810 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] credential.caching = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.639009 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.639195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.639544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] credential.caching = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.639729 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.639914 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.640113 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.640113 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.640458 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.640643 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.640824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.641011 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.641216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.641405 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.641596 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.641787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.641969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.642154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.642154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.642514 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.642514 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.642860 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.643056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.643280 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.643280 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.643626 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.643815 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.644003 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.644187 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.644496 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.644689 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] federation.caching = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.644689 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.645047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.645235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.645425 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.645891 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.645891 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.646247 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.646439 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.646641 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] federation.caching = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.646830 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.647034 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.647210 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.647210 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.647604 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.647791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.647978 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.648181 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.648364 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.648547 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.648744 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.648931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.caching = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.649118 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.649311 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.649311 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.649662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.649847 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.650033 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.650222 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.650425 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.650612 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.650612 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.650963 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.651159 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.651370 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.651578 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.651773 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.caching = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.651961 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.652151 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.652340 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.652340 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.652715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.652898 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.653080 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.653266 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.653450 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.653634 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.653832 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.654018 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.654204 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.654384 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.654384 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.654736 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.654935 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.655122 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.655390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.655584 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.655795 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.655795 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.656168 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.656353 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.656545 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.656735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.656923 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.657112 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.657310 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.657499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.657687 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.657876 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.657876 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.658233 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.658431 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.658617 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.658804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.658994 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.659173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.659173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.659528 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.659710 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.659893 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.660089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.660273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.660498 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.660498 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.660851 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.661037 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.661216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.661395 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.661579 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.661757 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.661945 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.662123 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.662123 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.662460 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.662654 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.662838 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.663024 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.663213 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.663470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.663639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.663833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.663833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.664174 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.664353 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.664536 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.664724 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.664928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.665111 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.665299 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.665481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.665481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.665819 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.666015 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.666197 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.666389 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.666577 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.666757 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.666943 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.667143 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.667143 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.667534 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.667725 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.667915 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.668106 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.668308 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.668494 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.668684 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.669376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.669376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.669731 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.669928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.670114 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.670295 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.670478 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.670668 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.670668 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.671027 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.671212 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.671415 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.671598 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.671781 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.671966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.671966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.672342 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.672526 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.672722 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.672919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.673105 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.673305 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.673494 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.673683 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.673874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.674061 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.674061 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.674423 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.674612 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.674795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.674977 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.675164 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.675395 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.675395 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.675776 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.675964 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.676156 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.676347 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.676532 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.676728 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.676728 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.677070 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.677255 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.677440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.677622 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.677819 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.678004 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.678004 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.678350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.678534 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.678719 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.678918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] resource.caching = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.679104 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.679309 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.679496 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.679685 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.679685 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.680060 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.680247 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.680421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.680605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.680793 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.680979 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.681270 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.681459 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.681459 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.681802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.681988 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.682185 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.682372 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] role.caching = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.682559 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.682750 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] role.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.682936 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.683126 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.683126 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.683519 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.683705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.683881 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.684064 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.684248 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.685065 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.685249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.685436 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.685436 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.685780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.685963 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.686167 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.686359 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.686544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.686729 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.686913 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.687098 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.687333 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.687497 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.687497 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.687747 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.687864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.688013 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.688013 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.688318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.688318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.688542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.688659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.688777 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.688904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.689021 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.689138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.689264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] resource.caching = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.689426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.689613 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.689780 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.689780 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.690022 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.690161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.690279 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.690418 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.690564 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.690684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.690810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.690926 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.690926 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.691150 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.691326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.691448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.691565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.691681 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.691798 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.691914 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.692039 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.692039 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.692259 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] role.caching = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.692376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.692524 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] role.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.692650 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] token.caching = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.692775 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.692893 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.693010 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.693126 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.693126 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.693314 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.693420 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.693537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.693654 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.693798 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.694168 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.694331 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.694457 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.694611 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.694735 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.694861 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.694861 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.695080 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.695213 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.695427 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.695603 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.695799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.695971 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.695971 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.696240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.696354 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.696470 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.696613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.696756 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.696876 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.connection = **** {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.696876 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.696876 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.697205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.697339 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.697458 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.697584 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.697705 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.697835 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.697835 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.698092 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.698220 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.698376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.698501 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.698628 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.698788 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.698788 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.699026 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.699154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.699409 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.699550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.699669 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.699789 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.699789 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.700082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.700200 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.700317 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.700433 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.700549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.700695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.700820 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.700956 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.700956 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 16:24:13.701182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.701182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.701182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.701182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.701182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.701182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.701182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] token.caching = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.701182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.701182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.702238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.702238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.702238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.702238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.702238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.702238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.702238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.702238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.702238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.703390 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.703390 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.703390 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.703390 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.703390 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.703390 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.703390 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.connection = **** {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.703390 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.703390 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.704830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.704830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.704830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.704830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.704830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.704830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.704830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.704830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.704830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.706166 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.706166 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.706166 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.706166 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.706166 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.706166 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.706166 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:24:13.706166 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 16:24:13.707379 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.707379 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.707379 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.708203 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.713872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.714150 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.714455 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.724964 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.745264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.745474 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.745568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.745735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.805812 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.806100 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.859029 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.859349 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.860155 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.860388 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.934017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.934285 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.934285 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.934563 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.934686 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.934804 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.934804 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.934997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.935133 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.935133 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.935403 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.935592 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.960874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.961217 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.961397 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.961544 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.961683 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.961822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.961961 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.962115 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.962253 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.962387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.962539 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.962674 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.962820 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.962992 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.975092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.975406 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.989515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.989781 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.989954 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.990084 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.990201 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.990201 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.990423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.990566 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.990566 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.990797 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.990919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.991043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.991272 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:13.991565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88349) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:24:14.008701 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.008965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.008965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:24:14.009228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:24:14.009465 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.009613 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.009751 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:24:14.009884 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:24:14.010076 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.010273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.010522 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.010676 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.010909 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.011055 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.011300 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.011471 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.021515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.021800 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.021950 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.022234 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.022420 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.022641 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.022788 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.023072 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.030736 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.031263 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.033904 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.034264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.034450 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.034645 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.034900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.035085 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.035364 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.035514 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.035748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.035892 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.036114 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.036259 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.036498 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.036642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.036873 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.037032 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.037250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.037460 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.037603 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.037871 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.038275 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.038641 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.062125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.064929 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.066622 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.066796 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.067060 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.067209 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.072106 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.072515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.072883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.073561 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.073925 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.074267 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.081387 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.081697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.083675 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.084050 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.086272 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.086592 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.086883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.087168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.087492 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.087903 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.088179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.088454 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.088844 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.089235 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.089572 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.089920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.090258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.090664 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.091140 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.091522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.108920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.109381 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.112092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.113595 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.120045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.120324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.120324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.120587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.121786 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.125383 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.125656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.125920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.128824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.129128 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.129411 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.129700 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.129977 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.130265 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.130391 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.133552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.137177 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.137514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.137805 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.138092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.138374 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.138772 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.146683 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.147100 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.147484 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.147836 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.154909 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.155136 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.155431 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.155717 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.158680 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.158840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.158840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.160435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.160811 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.161216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.161605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.161967 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.163070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.164834 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.165115 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.167953 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.168249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.168535 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.169422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.169710 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.174176 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.174509 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.174809 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.175069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.175377 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.175650 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.175924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.182558 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.182864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.183165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.183566 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.188646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.188646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.188646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.192092 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.195108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.198054 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.199668 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.200848 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.201382 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.201831 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.202121 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.203874 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.207029 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.208526 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.210075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.210362 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.210698 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.212999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.214738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.217697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.218046 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.218458 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.218833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.219158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.219378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.222146 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.222444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.222765 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.223107 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.228160 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.228546 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.228903 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.233217 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.233531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.233818 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.236713 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.237152 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.237557 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.237964 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.238370 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.238771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.239183 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.239617 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.240878 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88349) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:24:14.241782 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.241997 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.242182 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.242182 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.242477 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.242620 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.242620 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.242872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.243096 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.243283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.243424 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.243424 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.243679 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.243835 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.243835 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.244083 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.244212 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.244344 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.244507 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88349) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:24:14.278162 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b8fc3e9c0 pid: 88348 (default app) Aug 23 16:24:14.278562 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b8fc3e9c0 pid: 88349 (default app) Aug 23 16:24:14.281908 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88a088-0bbd-4e14-a48d-ac7bb75b3c0f None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:14.282132 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88a088-0bbd-4e14-a48d-ac7bb75b3c0f None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:14.282402 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88a088-0bbd-4e14-a48d-ac7bb75b3c0f None None] PATH_INFO: `/v3` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:14.286857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Tue Aug 23 16:24:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:22.558682 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262cd1e-096c-4001-b209-e540f86b4261 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:22.559376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262cd1e-096c-4001-b209-e540f86b4261 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:22.559376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262cd1e-096c-4001-b209-e540f86b4261 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:22.564596 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:22.572307 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b414afe-0f31-41f2-ac22-b739faa53082 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:22.572877 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b414afe-0f31-41f2-ac22-b739faa53082 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:22.573274 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b414afe-0f31-41f2-ac22-b739faa53082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:22.698747 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: INFO dbcounter [None req-2b414afe-0f31-41f2-ac22-b739faa53082 None None] Registered counter for database keystone Aug 23 16:24:22.722244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG oslo_db.sqlalchemy.engines [None req-2b414afe-0f31-41f2-ac22-b739faa53082 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:24:22.729085 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writer thread running {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:24:22.928874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG passlib.handlers.bcrypt [None req-2b414afe-0f31-41f2-ac22-b739faa53082 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88348) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 16:24:22.928874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG passlib.handlers.bcrypt [None req-2b414afe-0f31-41f2-ac22-b739faa53082 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88348) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 16:24:22.982771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-2b414afe-0f31-41f2-ac22-b739faa53082 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:22.984440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-2b414afe-0f31-41f2-ac22-b739faa53082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:23.127550 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 557 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 16:24:23.635053 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262cd1e-096c-4001-b209-e540f86b4261 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:23.711282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: INFO dbcounter [None req-3262cd1e-096c-4001-b209-e540f86b4261 None None] Registered counter for database keystone Aug 23 16:24:23.732359 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG oslo_db.sqlalchemy.engines [None req-3262cd1e-096c-4001-b209-e540f86b4261 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:24:23.739411 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writer thread running {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:24:23.865404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262cd1e-096c-4001-b209-e540f86b4261 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:23.869989 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596679d-9e03-48be-8683-de4a732c9f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:23.870678 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596679d-9e03-48be-8683-de4a732c9f0e admin admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:23.870998 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596679d-9e03-48be-8683-de4a732c9f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:23.871356 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596679d-9e03-48be-8683-de4a732c9f0e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:23.880897 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596679d-9e03-48be-8683-de4a732c9f0e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:23.933350 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d596679d-9e03-48be-8683-de4a732c9f0e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 16:24:23.933650 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596679d-9e03-48be-8683-de4a732c9f0e admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:23.945079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Aug 23 16:24:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 16:24:23.952417 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b414afe-0f31-41f2-ac22-b739faa53082 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:23.968980 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b414afe-0f31-41f2-ac22-b739faa53082 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:23.973869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcc00b-6919-47a7-8d4a-d92a5f18c01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:23.975063 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc00b-6919-47a7-8d4a-d92a5f18c01f admin admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:23.975396 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc00b-6919-47a7-8d4a-d92a5f18c01f admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:23.975673 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc00b-6919-47a7-8d4a-d92a5f18c01f admin admin] PATH_INFO: `/v3/projects/8f03f75490504c439981665b0cba53a2` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:23.979874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcc00b-6919-47a7-8d4a-d92a5f18c01f admin admin] RBAC: Authorizing `identity:get_project(project_id=8f03f75490504c439981665b0cba53a2)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:24.030921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a6fcc00b-6919-47a7-8d4a-d92a5f18c01f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 16:24:24.031283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcc00b-6919-47a7-8d4a-d92a5f18c01f admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:24.036111 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Aug 23 16:24:23 2022] GET /identity/v3/projects/8f03f75490504c439981665b0cba53a2 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:26.281066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046d3a4-a466-4743-840d-793ee8516ffd None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:26.281617 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046d3a4-a466-4743-840d-793ee8516ffd None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:26.281617 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046d3a4-a466-4743-840d-793ee8516ffd None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:26.286092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:26.292297 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571e750-1245-4573-876c-8c450c7f6f4a None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:26.292825 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571e750-1245-4573-876c-8c450c7f6f4a None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:26.292825 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571e750-1245-4573-876c-8c450c7f6f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:26.314150 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-c571e750-1245-4573-876c-8c450c7f6f4a None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:26.315816 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-c571e750-1245-4573-876c-8c450c7f6f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:26.324155 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 23 16:24:26.649030 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046d3a4-a466-4743-840d-793ee8516ffd None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:26.662337 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046d3a4-a466-4743-840d-793ee8516ffd None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:26.666696 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29061583-52cf-4e9f-a883-ce8f3270573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:26.667347 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29061583-52cf-4e9f-a883-ce8f3270573e admin admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:26.667635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29061583-52cf-4e9f-a883-ce8f3270573e admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:26.667909 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29061583-52cf-4e9f-a883-ce8f3270573e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:26.677411 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29061583-52cf-4e9f-a883-ce8f3270573e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:26.679252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29061583-52cf-4e9f-a883-ce8f3270573e admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:26.689593 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Aug 23 16:24:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 16:24:26.696237 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571e750-1245-4573-876c-8c450c7f6f4a None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:26.712427 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571e750-1245-4573-876c-8c450c7f6f4a None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:26.720332 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcf626-ebf6-4467-bcfb-74f96c223ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:26.721347 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcf626-ebf6-4467-bcfb-74f96c223ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:26.721801 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcf626-ebf6-4467-bcfb-74f96c223ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:26.722248 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcf626-ebf6-4467-bcfb-74f96c223ac1 admin admin] PATH_INFO: `/v3/users/b441ea8946b74edd833bbf63322f9350` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:26.724445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcf626-ebf6-4467-bcfb-74f96c223ac1 admin admin] RBAC: Authorizing `identity:get_user(user_id=b441ea8946b74edd833bbf63322f9350)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:26.727956 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcf626-ebf6-4467-bcfb-74f96c223ac1 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:26.730863 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Aug 23 16:24:26 2022] GET /identity/v3/users/b441ea8946b74edd833bbf63322f9350 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:29.176991 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638b45-9552-4a9c-b168-64d95f8c9d0a None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:29.177965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638b45-9552-4a9c-b168-64d95f8c9d0a None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:29.177965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638b45-9552-4a9c-b168-64d95f8c9d0a None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:29.178791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:24:29.186248 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6ed0-d01c-48da-b132-fa22aa121b0d None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:29.186783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6ed0-d01c-48da-b132-fa22aa121b0d None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:29.187346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6ed0-d01c-48da-b132-fa22aa121b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:29.204375 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3beb4-57d2-4413-8fe9-a15a713b5e74 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:29.204793 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3beb4-57d2-4413-8fe9-a15a713b5e74 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:29.205192 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3beb4-57d2-4413-8fe9-a15a713b5e74 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:29.206656 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:24:29.213944 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f72f-ab7d-467b-8d15-2dc50df95efa None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:29.214279 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f72f-ab7d-467b-8d15-2dc50df95efa None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:29.214763 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f72f-ab7d-467b-8d15-2dc50df95efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:29.219456 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-fffd6ed0-d01c-48da-b132-fa22aa121b0d None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:29.221515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-fffd6ed0-d01c-48da-b132-fa22aa121b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:29.261229 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG passlib.handlers.bcrypt [None req-2d09f72f-ab7d-467b-8d15-2dc50df95efa None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88349) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 16:24:29.261658 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG passlib.handlers.bcrypt [None req-2d09f72f-ab7d-467b-8d15-2dc50df95efa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88349) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 16:24:29.310547 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-2d09f72f-ab7d-467b-8d15-2dc50df95efa None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:29.312240 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-2d09f72f-ab7d-467b-8d15-2dc50df95efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:29.365252 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:29.418081 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:24:29.767936 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd6ed0-d01c-48da-b132-fa22aa121b0d None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:29.796959 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:29.992807 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09f72f-ab7d-467b-8d15-2dc50df95efa None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:30.020523 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd6ed0-d01c-48da-b132-fa22aa121b0d None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:30.070946 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e514fb3-f04d-4b49-baa6-354eb350db97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:30.071775 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e514fb3-f04d-4b49-baa6-354eb350db97 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:30.072129 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e514fb3-f04d-4b49-baa6-354eb350db97 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:30.072507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e514fb3-f04d-4b49-baa6-354eb350db97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:30.130574 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09f72f-ab7d-467b-8d15-2dc50df95efa None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:30.133926 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:30.170878 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e514fb3-f04d-4b49-baa6-354eb350db97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:30.173507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e514fb3-f04d-4b49-baa6-354eb350db97 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:30.187924 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1738fba-48f7-43d5-8e79-415bb4f3f18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:30.189207 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1738fba-48f7-43d5-8e79-415bb4f3f18c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:30.189562 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1738fba-48f7-43d5-8e79-415bb4f3f18c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:30.189983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1738fba-48f7-43d5-8e79-415bb4f3f18c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:30.211954 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:30.212981 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1738fba-48f7-43d5-8e79-415bb4f3f18c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-c1738fba-48f7-43d5-8e79-415bb4f3f18c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:24:30.223997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:30.226035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:30.228659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:30.228659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:30.228659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:30.228659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:30.228659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:24:30.228659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:24:30.228659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:24:30.228659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:24:30.228659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:24:30.228659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:24:30.228659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:24:30.228659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:24:30.228659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 8/14] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:24:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:24:30.232829 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1738fba-48f7-43d5-8e79-415bb4f3f18c None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:30.341508 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 7/15] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:24:30.349996 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e514fb3-f04d-4b49-baa6-354eb350db97 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:30.397988 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1738fba-48f7-43d5-8e79-415bb4f3f18c None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:30.451426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733869b-6b3d-4d62-b28c-eb78aed796b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:30.452048 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733869b-6b3d-4d62-b28c-eb78aed796b1 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:30.452330 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733869b-6b3d-4d62-b28c-eb78aed796b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:30.452604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733869b-6b3d-4d62-b28c-eb78aed796b1 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:30.453277 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733869b-6b3d-4d62-b28c-eb78aed796b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:30.453588 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733869b-6b3d-4d62-b28c-eb78aed796b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:30.455084 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733869b-6b3d-4d62-b28c-eb78aed796b1 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:30.469680 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 9/16] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:24:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:24:30.475621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733869b-6b3d-4d62-b28c-eb78aed796b1 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:30.496363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e514fb3-f04d-4b49-baa6-354eb350db97 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:30.510231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:30.524569 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:30.538242 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65d85d-59cf-45eb-ad71-515504bd40aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:30.538906 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65d85d-59cf-45eb-ad71-515504bd40aa None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:30.539186 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65d85d-59cf-45eb-ad71-515504bd40aa None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:30.539494 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65d85d-59cf-45eb-ad71-515504bd40aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:30.553157 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65d85d-59cf-45eb-ad71-515504bd40aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:30.555488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65d85d-59cf-45eb-ad71-515504bd40aa None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-3a65d85d-59cf-45eb-ad71-515504bd40aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:24:30.575273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:30.585298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:24:30.586740 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:24:30.586740 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:24:30.586740 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:24:30.586740 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 8/17] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:24:30.586740 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65d85d-59cf-45eb-ad71-515504bd40aa None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:30.609842 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733869b-6b3d-4d62-b28c-eb78aed796b1 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:30.648748 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446ba44-1bca-455b-9115-f1dd00585855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:30.649400 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ba44-1bca-455b-9115-f1dd00585855 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:30.649681 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ba44-1bca-455b-9115-f1dd00585855 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:30.649955 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ba44-1bca-455b-9115-f1dd00585855 None admin] PATH_INFO: `/v3/users/b441ea8946b74edd833bbf63322f9350` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:30.651563 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446ba44-1bca-455b-9115-f1dd00585855 None admin] RBAC: Authorizing `identity:get_user(user_id=b441ea8946b74edd833bbf63322f9350)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:30.653057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446ba44-1bca-455b-9115-f1dd00585855 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:30.654816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:24:30 2022] GET /identity/v3/users/b441ea8946b74edd833bbf63322f9350 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:24:30.660584 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446ba44-1bca-455b-9115-f1dd00585855 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:30.726108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65d85d-59cf-45eb-ad71-515504bd40aa None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:30.770188 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bcec1-dc14-4996-8bc5-cf1212a654e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:30.771013 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bcec1-dc14-4996-8bc5-cf1212a654e6 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:30.771531 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bcec1-dc14-4996-8bc5-cf1212a654e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:30.772264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bcec1-dc14-4996-8bc5-cf1212a654e6 None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:30.773429 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bcec1-dc14-4996-8bc5-cf1212a654e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:30.773966 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bcec1-dc14-4996-8bc5-cf1212a654e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:30.776047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bcec1-dc14-4996-8bc5-cf1212a654e6 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:30.799114 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:30.904764 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:30.912571 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446ba44-1bca-455b-9115-f1dd00585855 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:30.954594 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10361f1c-d3c8-4380-b801-a863d16aaf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:30.955375 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10361f1c-d3c8-4380-b801-a863d16aaf0f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:30.955722 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10361f1c-d3c8-4380-b801-a863d16aaf0f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:30.956061 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10361f1c-d3c8-4380-b801-a863d16aaf0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:30.957379 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10361f1c-d3c8-4380-b801-a863d16aaf0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:30.958976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10361f1c-d3c8-4380-b801-a863d16aaf0f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:30.961045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:24:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:24:30.968274 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bcec1-dc14-4996-8bc5-cf1212a654e6 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:31.020553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:31.098405 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bcec1-dc14-4996-8bc5-cf1212a654e6 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:31.149402 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c141416-2c9e-4d82-a855-74ff44dcfd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:31.150028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141416-2c9e-4d82-a855-74ff44dcfd88 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:31.150306 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141416-2c9e-4d82-a855-74ff44dcfd88 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:31.150577 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141416-2c9e-4d82-a855-74ff44dcfd88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:31.151379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c141416-2c9e-4d82-a855-74ff44dcfd88 None admin] RBAC: Adding query filter params (role.id=091802a86e334e129210219b7c69359d, scope.domain.id=default, user.id=b441ea8946b74edd833bbf63322f9350) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:31.151689 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c141416-2c9e-4d82-a855-74ff44dcfd88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:31.153372 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c141416-2c9e-4d82-a855-74ff44dcfd88 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:31.163335 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Aug 23 16:24:30 2022] GET /identity/v3/role_assignments?user.id=b441ea8946b74edd833bbf63322f9350&scope.domain.id=default&role.id=091802a86e334e129210219b7c69359d => generated 233 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:33.763794 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288d75c-bfb2-4a57-98ff-a8b09e489053 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:33.764356 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288d75c-bfb2-4a57-98ff-a8b09e489053 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:33.764356 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288d75c-bfb2-4a57-98ff-a8b09e489053 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:33.765820 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:33.773674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94590c04-a107-4a59-84c4-bc849f74798f None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:33.774097 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94590c04-a107-4a59-84c4-bc849f74798f None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:33.774261 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94590c04-a107-4a59-84c4-bc849f74798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:33.801565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557751c-5477-4036-88d6-03217e3f9d47 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:33.802420 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557751c-5477-4036-88d6-03217e3f9d47 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:33.802918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557751c-5477-4036-88d6-03217e3f9d47 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:33.804608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 13/23] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:24:33.812480 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-94590c04-a107-4a59-84c4-bc849f74798f None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:33.814139 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-94590c04-a107-4a59-84c4-bc849f74798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:33.825666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4e576-8333-4a3f-ac6d-e6eca4d00f39 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:33.826285 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4e576-8333-4a3f-ac6d-e6eca4d00f39 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:33.826792 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4e576-8333-4a3f-ac6d-e6eca4d00f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:33.853342 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-18b4e576-8333-4a3f-ac6d-e6eca4d00f39 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:33.855155 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-18b4e576-8333-4a3f-ac6d-e6eca4d00f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:33.984658 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 11/24] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:24:34.002687 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 14/25] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:24:34.341253 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd701aac-aeca-40de-993b-bad850e0b0e7 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:34.341972 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd701aac-aeca-40de-993b-bad850e0b0e7 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:34.342467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd701aac-aeca-40de-993b-bad850e0b0e7 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:34.344061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 12/26] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:34.349927 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f05e98-2718-4316-b951-66392ac01b3e None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:34.350525 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f05e98-2718-4316-b951-66392ac01b3e None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:34.351029 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f05e98-2718-4316-b951-66392ac01b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:34.381818 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-68f05e98-2718-4316-b951-66392ac01b3e None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:34.383417 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-68f05e98-2718-4316-b951-66392ac01b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:34.388456 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd701aac-aeca-40de-993b-bad850e0b0e7 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:34.441472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:34.570113 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 15/27] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:34.585337 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f05e98-2718-4316-b951-66392ac01b3e None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:34.624540 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd701aac-aeca-40de-993b-bad850e0b0e7 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:34.630736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:34.710164 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd6642-b6b8-476c-ad01-6872821348d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:34.711274 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd6642-b6b8-476c-ad01-6872821348d3 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:34.711765 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd6642-b6b8-476c-ad01-6872821348d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:34.712332 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd6642-b6b8-476c-ad01-6872821348d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:34.750777 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd6642-b6b8-476c-ad01-6872821348d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:34.754218 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd6642-b6b8-476c-ad01-6872821348d3 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-6dcd6642-b6b8-476c-ad01-6872821348d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:24:34.807273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:34.809921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:24:34.811743 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:24:34.811743 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:24:34.811743 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:24:34.814568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 13/28] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:24:34.821920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd6642-b6b8-476c-ad01-6872821348d3 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:34.832426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f05e98-2718-4316-b951-66392ac01b3e None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:34.952564 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7983955-f291-4299-a517-6e45a865f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:34.953088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983955-f291-4299-a517-6e45a865f4c5 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:34.953373 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983955-f291-4299-a517-6e45a865f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:34.953647 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983955-f291-4299-a517-6e45a865f4c5 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:34.954337 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7983955-f291-4299-a517-6e45a865f4c5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:34.959986 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7983955-f291-4299-a517-6e45a865f4c5 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:35.018792 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:35.043406 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd6642-b6b8-476c-ad01-6872821348d3 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:35.096916 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebaf1c-1ca6-48d3-b6f9-52e285063d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:35.097615 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebaf1c-1ca6-48d3-b6f9-52e285063d9c None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:35.097907 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebaf1c-1ca6-48d3-b6f9-52e285063d9c None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:35.098186 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebaf1c-1ca6-48d3-b6f9-52e285063d9c None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:35.098875 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebaf1c-1ca6-48d3-b6f9-52e285063d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:35.099182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebaf1c-1ca6-48d3-b6f9-52e285063d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:35.103301 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebaf1c-1ca6-48d3-b6f9-52e285063d9c None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:35.128717 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 14/29] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:35.134447 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f409a-3555-46f3-98b3-a2da9167b085 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:35.134796 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f409a-3555-46f3-98b3-a2da9167b085 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:35.135027 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f409a-3555-46f3-98b3-a2da9167b085 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:35.136411 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:35.137224 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f409a-3555-46f3-98b3-a2da9167b085 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:35.269247 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 16/31] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Aug 23 16:24:34 2022] POST /identity/v3/roles => generated 219 bytes in 684 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:24:35.276406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb26f7-4066-40be-91e3-88e65633d3d0 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:35.277029 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb26f7-4066-40be-91e3-88e65633d3d0 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:35.277690 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb26f7-4066-40be-91e3-88e65633d3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:35.314991 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-b6eb26f7-4066-40be-91e3-88e65633d3d0 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:35.317874 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-b6eb26f7-4066-40be-91e3-88e65633d3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:35.417738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f409a-3555-46f3-98b3-a2da9167b085 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:35.485609 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c393d-f521-4d08-ac66-7425bb21a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:35.487000 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c393d-f521-4d08-ac66-7425bb21a76e None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:35.487732 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c393d-f521-4d08-ac66-7425bb21a76e None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:35.488448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c393d-f521-4d08-ac66-7425bb21a76e None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:35.489990 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c393d-f521-4d08-ac66-7425bb21a76e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:35.490516 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 17/32] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:35.493802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c393d-f521-4d08-ac66-7425bb21a76e None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:35.500476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad0104-339c-437c-bee9-ab215f411733 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:35.500853 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad0104-339c-437c-bee9-ab215f411733 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:35.501227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad0104-339c-437c-bee9-ab215f411733 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:35.503204 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 18/33] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:35 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:35.504182 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad0104-339c-437c-bee9-ab215f411733 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:35.529933 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:35.545418 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:35.715141 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad0104-339c-437c-bee9-ab215f411733 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:35.781073 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb99db-54fc-41ae-b8e5-f5c4cd1a941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:35.782101 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb99db-54fc-41ae-b8e5-f5c4cd1a941d None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:35.782701 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb99db-54fc-41ae-b8e5-f5c4cd1a941d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:35.783140 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb99db-54fc-41ae-b8e5-f5c4cd1a941d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:35.807262 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 16/34] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Aug 23 16:24:35 2022] POST /identity/v3/projects => generated 301 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:24:35.807262 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32324aec-96de-4c51-bda3-53972d695e1d None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:35.807262 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32324aec-96de-4c51-bda3-53972d695e1d None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:35.807262 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32324aec-96de-4c51-bda3-53972d695e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:35.815557 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb99db-54fc-41ae-b8e5-f5c4cd1a941d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-71fb99db-54fc-41ae-b8e5-f5c4cd1a941d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:24:35.826235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:35.827361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:35.828306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:35.828306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:35.828306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:35.828306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:35.828306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:24:35.828306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:24:35.828306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:24:35.828306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:24:35.828306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:24:35.828306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:24:35.828306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:24:35.828306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:24:35.831183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 19/35] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:24:35.834283 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ac183-d868-472e-ad6e-df090571c3aa None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:35.834852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ac183-d868-472e-ad6e-df090571c3aa None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:35.835314 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ac183-d868-472e-ad6e-df090571c3aa None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:35.837654 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 20/36] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:35.839112 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ac183-d868-472e-ad6e-df090571c3aa None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:35.839823 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-32324aec-96de-4c51-bda3-53972d695e1d None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:35.845270 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-32324aec-96de-4c51-bda3-53972d695e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:35.941209 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:35.963326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 17/37] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:35.963326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32324aec-96de-4c51-bda3-53972d695e1d None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:36.008608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ac183-d868-472e-ad6e-df090571c3aa None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:36.086127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e5a41-ba83-4480-9f79-a67faf8d8e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:36.087659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e5a41-ba83-4480-9f79-a67faf8d8e7a None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:36.088553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e5a41-ba83-4480-9f79-a67faf8d8e7a None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:36.089138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e5a41-ba83-4480-9f79-a67faf8d8e7a None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:36.090405 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e5a41-ba83-4480-9f79-a67faf8d8e7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:36.091202 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e5a41-ba83-4480-9f79-a67faf8d8e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:36.093792 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e5a41-ba83-4480-9f79-a67faf8d8e7a None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:36.098727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32324aec-96de-4c51-bda3-53972d695e1d None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:36.109307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 21/38] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:24:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:36.111797 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad2dff-a4b4-44d4-8b8a-ac493c6c7e17 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:36.112279 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad2dff-a4b4-44d4-8b8a-ac493c6c7e17 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:36.112778 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad2dff-a4b4-44d4-8b8a-ac493c6c7e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:36.133339 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:36.138768 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-44ad2dff-a4b4-44d4-8b8a-ac493c6c7e17 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:36.140054 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-44ad2dff-a4b4-44d4-8b8a-ac493c6c7e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:36.152907 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162a9d1-75ae-43b6-8180-fbf6080304fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:36.153847 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162a9d1-75ae-43b6-8180-fbf6080304fa None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:36.154156 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162a9d1-75ae-43b6-8180-fbf6080304fa None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:36.154562 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162a9d1-75ae-43b6-8180-fbf6080304fa None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:36.155158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162a9d1-75ae-43b6-8180-fbf6080304fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:36.159045 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162a9d1-75ae-43b6-8180-fbf6080304fa None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:36.224764 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 22/39] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:36.225769 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad2dff-a4b4-44d4-8b8a-ac493c6c7e17 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:36.243281 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 18/40] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Aug 23 16:24:35 2022] POST /identity/v3/roles => generated 225 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:24:36.331746 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:36.409569 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad2dff-a4b4-44d4-8b8a-ac493c6c7e17 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:36.457850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4703a1f-1b19-47c4-a2ed-aa8787ef2e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:36.458697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4703a1f-1b19-47c4-a2ed-aa8787ef2e36 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:36.459067 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4703a1f-1b19-47c4-a2ed-aa8787ef2e36 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:36.459390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4703a1f-1b19-47c4-a2ed-aa8787ef2e36 None admin] PATH_INFO: `/v3/users/b441ea8946b74edd833bbf63322f9350` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:36.460808 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4703a1f-1b19-47c4-a2ed-aa8787ef2e36 None admin] RBAC: Authorizing `identity:get_user(user_id=b441ea8946b74edd833bbf63322f9350)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:36.462297 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4703a1f-1b19-47c4-a2ed-aa8787ef2e36 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:36.463962 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 23/41] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:24:36 2022] GET /identity/v3/users/b441ea8946b74edd833bbf63322f9350 => generated 247 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:36.471292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162a9d1-75ae-43b6-8180-fbf6080304fa None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:36.575680 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4703a1f-1b19-47c4-a2ed-aa8787ef2e36 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:36.608607 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162a9d1-75ae-43b6-8180-fbf6080304fa None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:36.667591 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3ade8-e45b-4e2e-aac6-0952d4af9761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:36.668914 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3ade8-e45b-4e2e-aac6-0952d4af9761 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:36.669569 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3ade8-e45b-4e2e-aac6-0952d4af9761 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:36.670417 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3ade8-e45b-4e2e-aac6-0952d4af9761 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:36.671858 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3ade8-e45b-4e2e-aac6-0952d4af9761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:36.674498 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3ade8-e45b-4e2e-aac6-0952d4af9761 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:36.678958 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 19/42] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:24:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:36.685691 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3ade8-e45b-4e2e-aac6-0952d4af9761 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:36.702693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4703a1f-1b19-47c4-a2ed-aa8787ef2e36 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:36.735086 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:36.742976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90540569-4130-406d-8751-413106eed96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:36.742976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90540569-4130-406d-8751-413106eed96d None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:36.742976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90540569-4130-406d-8751-413106eed96d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:36.742976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90540569-4130-406d-8751-413106eed96d None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:36.750499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90540569-4130-406d-8751-413106eed96d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:36.750499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90540569-4130-406d-8751-413106eed96d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:36.754418 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:36.813585 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 24/43] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Aug 23 16:24:36 2022] POST /identity/v3/roles => generated 223 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:24:36.814407 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90540569-4130-406d-8751-413106eed96d None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:36.839352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3ade8-e45b-4e2e-aac6-0952d4af9761 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:36.909641 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9edb03-40b7-4981-a418-31db7478205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:36.910730 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9edb03-40b7-4981-a418-31db7478205a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:36.911204 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9edb03-40b7-4981-a418-31db7478205a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:36.911721 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9edb03-40b7-4981-a418-31db7478205a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:36.913880 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9edb03-40b7-4981-a418-31db7478205a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:36.916685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9edb03-40b7-4981-a418-31db7478205a None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:36.919893 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 20/44] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:24:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:36.929164 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9edb03-40b7-4981-a418-31db7478205a None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:36.946487 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90540569-4130-406d-8751-413106eed96d None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:36.997099 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac33bb-5203-463b-b3e3-2e306d4fb0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:36.999009 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac33bb-5203-463b-b3e3-2e306d4fb0db None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:36.999332 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac33bb-5203-463b-b3e3-2e306d4fb0db None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:36.999615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac33bb-5203-463b-b3e3-2e306d4fb0db None admin] PATH_INFO: `/v3/domains/default/users/b441ea8946b74edd833bbf63322f9350/roles/091802a86e334e129210219b7c69359d` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:37.001866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac33bb-5203-463b-b3e3-2e306d4fb0db None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b441ea8946b74edd833bbf63322f9350, role_id=091802a86e334e129210219b7c69359d)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:37.003489 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac33bb-5203-463b-b3e3-2e306d4fb0db None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:37.070070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 25/45] 10.222.0.18 () {58 vars in 1361 bytes} [Tue Aug 23 16:24:36 2022] PUT /identity/v3/domains/default/users/b441ea8946b74edd833bbf63322f9350/roles/091802a86e334e129210219b7c69359d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:24:37.085606 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9edb03-40b7-4981-a418-31db7478205a None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:37.110148 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:37.134954 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e7c30-3200-4edf-8fac-45e4e1a740d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:37.135633 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e7c30-3200-4edf-8fac-45e4e1a740d2 None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:37.135912 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e7c30-3200-4edf-8fac-45e4e1a740d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:37.136187 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e7c30-3200-4edf-8fac-45e4e1a740d2 None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:37.136874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e7c30-3200-4edf-8fac-45e4e1a740d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:37.139040 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e7c30-3200-4edf-8fac-45e4e1a740d2 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:37.227213 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 21/46] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Aug 23 16:24:36 2022] POST /identity/v3/projects => generated 312 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:24:39.327509 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519383d-7691-4c84-8133-659c11f1c8e7 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:39.328150 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519383d-7691-4c84-8133-659c11f1c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:39.328150 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519383d-7691-4c84-8133-659c11f1c8e7 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:39.329733 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 26/47] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:24:39.335568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f594ac-1737-459b-bab8-bd7a03a2cdf6 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:39.336316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f594ac-1737-459b-bab8-bd7a03a2cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:39.336492 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f594ac-1737-459b-bab8-bd7a03a2cdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:39.355090 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-c7f594ac-1737-459b-bab8-bd7a03a2cdf6 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:39.356374 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-c7f594ac-1737-459b-bab8-bd7a03a2cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:39.426899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 22/48] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:39.474104 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9acc5-a4e6-450a-a0c0-e3fd5aeece9e None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:39.474528 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9acc5-a4e6-450a-a0c0-e3fd5aeece9e None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:39.474899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9acc5-a4e6-450a-a0c0-e3fd5aeece9e None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:39.476427 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 27/49] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:39.482952 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495bf10-950d-42c7-a2b2-b6dc525cdd7a None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:39.483292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495bf10-950d-42c7-a2b2-b6dc525cdd7a None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:39.483570 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495bf10-950d-42c7-a2b2-b6dc525cdd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:39.501925 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-2495bf10-950d-42c7-a2b2-b6dc525cdd7a None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:39.503141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-2495bf10-950d-42c7-a2b2-b6dc525cdd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:39.583883 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 23/50] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:39.758546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9acc5-a4e6-450a-a0c0-e3fd5aeece9e None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:39.816229 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:39.866589 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9acc5-a4e6-450a-a0c0-e3fd5aeece9e None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:39.905661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7530a9-a222-4ea2-99d7-62b8b1b92b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:39.906300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7530a9-a222-4ea2-99d7-62b8b1b92b64 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:39.906573 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7530a9-a222-4ea2-99d7-62b8b1b92b64 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:39.906850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7530a9-a222-4ea2-99d7-62b8b1b92b64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:39.914673 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495bf10-950d-42c7-a2b2-b6dc525cdd7a None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:39.923649 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7530a9-a222-4ea2-99d7-62b8b1b92b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-5f7530a9-a222-4ea2-99d7-62b8b1b92b64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:24:39.934882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:39.936091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:39.937533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:39.937533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:39.937533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:39.937533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:39.937533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:24:39.937533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:24:39.937533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:24:39.937533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:24:39.937533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:24:39.937533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:24:39.937533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:24:39.937533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:24:39.937533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 28/51] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:24:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:24:39.942086 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7530a9-a222-4ea2-99d7-62b8b1b92b64 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:39.948115 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:40.031913 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495bf10-950d-42c7-a2b2-b6dc525cdd7a None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:40.067374 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7530a9-a222-4ea2-99d7-62b8b1b92b64 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:40.085584 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e126f1-0840-438b-b9dd-11c5dfbd2a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:40.086331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e126f1-0840-438b-b9dd-11c5dfbd2a8f None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:40.086673 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e126f1-0840-438b-b9dd-11c5dfbd2a8f None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:40.087014 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e126f1-0840-438b-b9dd-11c5dfbd2a8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:40.087698 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:40.088842 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e126f1-0840-438b-b9dd-11c5dfbd2a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:40.090613 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e126f1-0840-438b-b9dd-11c5dfbd2a8f None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:40.092547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 24/52] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:24:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:24:40.098514 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e126f1-0840-438b-b9dd-11c5dfbd2a8f None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:40.121113 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628b730-d7dc-4f39-b4c0-fed01aeb03d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:40.122048 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628b730-d7dc-4f39-b4c0-fed01aeb03d9 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:40.123108 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628b730-d7dc-4f39-b4c0-fed01aeb03d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:40.123474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628b730-d7dc-4f39-b4c0-fed01aeb03d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:40.124671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628b730-d7dc-4f39-b4c0-fed01aeb03d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:40.125104 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628b730-d7dc-4f39-b4c0-fed01aeb03d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:40.127151 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628b730-d7dc-4f39-b4c0-fed01aeb03d9 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:40.137589 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 29/53] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:24:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:24:40.144379 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628b730-d7dc-4f39-b4c0-fed01aeb03d9 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:40.211790 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:40.216632 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e126f1-0840-438b-b9dd-11c5dfbd2a8f None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:40.251732 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628b730-d7dc-4f39-b4c0-fed01aeb03d9 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:40.260583 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb6bbf-370b-486d-a6df-5744261a4133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:40.261206 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb6bbf-370b-486d-a6df-5744261a4133 None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:40.261489 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb6bbf-370b-486d-a6df-5744261a4133 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:40.261763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb6bbf-370b-486d-a6df-5744261a4133 None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:40.262416 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb6bbf-370b-486d-a6df-5744261a4133 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:40.264517 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb6bbf-370b-486d-a6df-5744261a4133 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:40.296149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da1cf6-0050-4c72-999e-127fac54c421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:40.296785 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da1cf6-0050-4c72-999e-127fac54c421 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:40.298910 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da1cf6-0050-4c72-999e-127fac54c421 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:40.298910 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da1cf6-0050-4c72-999e-127fac54c421 None admin] PATH_INFO: `/v3/users/b441ea8946b74edd833bbf63322f9350` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:40.298910 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da1cf6-0050-4c72-999e-127fac54c421 None admin] RBAC: Authorizing `identity:get_user(user_id=b441ea8946b74edd833bbf63322f9350)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:40.299939 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da1cf6-0050-4c72-999e-127fac54c421 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:40.301500 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 30/54] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:24:40 2022] GET /identity/v3/users/b441ea8946b74edd833bbf63322f9350 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:24:40.306995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da1cf6-0050-4c72-999e-127fac54c421 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:40.352116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:40.391572 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 25/55] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Aug 23 16:24:40 2022] POST /identity/v3/projects => generated 298 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:24:40.428728 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da1cf6-0050-4c72-999e-127fac54c421 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:40.472033 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db2ead-08b5-428f-aa8a-bae5ed761c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:40.472715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db2ead-08b5-428f-aa8a-bae5ed761c35 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:40.473003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db2ead-08b5-428f-aa8a-bae5ed761c35 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:40.473286 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db2ead-08b5-428f-aa8a-bae5ed761c35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:40.474653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db2ead-08b5-428f-aa8a-bae5ed761c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:40.476291 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db2ead-08b5-428f-aa8a-bae5ed761c35 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:40.478334 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 31/56] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:24:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:24:40.484899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb6bbf-370b-486d-a6df-5744261a4133 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:40.625278 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb6bbf-370b-486d-a6df-5744261a4133 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:40.668849 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b2e4b-5c43-4c5e-a09e-7fb74e14a0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:40.669386 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2e4b-5c43-4c5e-a09e-7fb74e14a0c9 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:40.670182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2e4b-5c43-4c5e-a09e-7fb74e14a0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:40.670455 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2e4b-5c43-4c5e-a09e-7fb74e14a0c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:40.671211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b2e4b-5c43-4c5e-a09e-7fb74e14a0c9 None admin] RBAC: Adding query filter params (role.id=091802a86e334e129210219b7c69359d, scope.domain.id=default, user.id=b441ea8946b74edd833bbf63322f9350) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:40.671593 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b2e4b-5c43-4c5e-a09e-7fb74e14a0c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:40.673098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b2e4b-5c43-4c5e-a09e-7fb74e14a0c9 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:40.682156 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 26/57] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Aug 23 16:24:40 2022] GET /identity/v3/role_assignments?user.id=b441ea8946b74edd833bbf63322f9350&scope.domain.id=default&role.id=091802a86e334e129210219b7c69359d => generated 530 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:42.671760 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44967a-e48f-49e0-b499-0eb2e373354b None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:42.672293 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44967a-e48f-49e0-b499-0eb2e373354b None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:42.672293 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44967a-e48f-49e0-b499-0eb2e373354b None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:42.673640 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 32/58] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:42.679016 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5b6b6-8083-404c-905f-b71a7d6c7896 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:42.679486 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5b6b6-8083-404c-905f-b71a7d6c7896 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:42.679643 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5b6b6-8083-404c-905f-b71a7d6c7896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:42.697215 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-5df5b6b6-8083-404c-905f-b71a7d6c7896 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:42.698418 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-5df5b6b6-8083-404c-905f-b71a7d6c7896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:42.708607 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:42.769120 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 27/59] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:43.091372 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44967a-e48f-49e0-b499-0eb2e373354b None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:43.198353 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44967a-e48f-49e0-b499-0eb2e373354b None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:43.210381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:43.233060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4604ff-1f4f-4897-a0ce-b921fa46c026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:43.233690 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4604ff-1f4f-4897-a0ce-b921fa46c026 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:43.233967 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4604ff-1f4f-4897-a0ce-b921fa46c026 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:43.234237 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4604ff-1f4f-4897-a0ce-b921fa46c026 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:43.235573 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4604ff-1f4f-4897-a0ce-b921fa46c026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:43.237005 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4604ff-1f4f-4897-a0ce-b921fa46c026 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:43.238563 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 33/60] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:24:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:43.244278 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5b6b6-8083-404c-905f-b71a7d6c7896 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:43.357620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5b6b6-8083-404c-905f-b71a7d6c7896 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:43.395782 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e216324-0a06-46c3-b881-9b2ceaad34cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:43.397824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e216324-0a06-46c3-b881-9b2ceaad34cf None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:43.397824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e216324-0a06-46c3-b881-9b2ceaad34cf None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:43.397824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e216324-0a06-46c3-b881-9b2ceaad34cf None admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:43.397824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e216324-0a06-46c3-b881-9b2ceaad34cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:43.399433 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e216324-0a06-46c3-b881-9b2ceaad34cf None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:43.552115 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:43.556894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 28/61] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Aug 23 16:24:43 2022] POST /identity/v3/users => generated 275 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:24:47.175722 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0872732-b03d-4a94-8c7b-ee0748db0b78 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:47.176236 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0872732-b03d-4a94-8c7b-ee0748db0b78 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:47.176314 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0872732-b03d-4a94-8c7b-ee0748db0b78 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:47.185815 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 34/62] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:47.192174 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7b8e-68a3-46be-be5c-f8b924c368e8 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:47.192670 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7b8e-68a3-46be-be5c-f8b924c368e8 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:47.192894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7b8e-68a3-46be-be5c-f8b924c368e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:47.229624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-f91e7b8e-68a3-46be-be5c-f8b924c368e8 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:47.231744 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-f91e7b8e-68a3-46be-be5c-f8b924c368e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:47.406810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 29/63] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:47.614011 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa443c-1069-475d-9031-6e798a77671b None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:47.614307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa443c-1069-475d-9031-6e798a77671b None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:47.614694 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa443c-1069-475d-9031-6e798a77671b None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:47.616440 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 35/64] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:47.623572 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8c4bc-3dbc-47a6-82f5-07b5f55fdb93 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:47.623968 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8c4bc-3dbc-47a6-82f5-07b5f55fdb93 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:47.624234 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8c4bc-3dbc-47a6-82f5-07b5f55fdb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:47.656534 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-08a8c4bc-3dbc-47a6-82f5-07b5f55fdb93 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:47.657793 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-08a8c4bc-3dbc-47a6-82f5-07b5f55fdb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:47.686093 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5b12f-e620-4763-ad4f-2a82842be318 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:47.686529 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5b12f-e620-4763-ad4f-2a82842be318 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:47.686789 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5b12f-e620-4763-ad4f-2a82842be318 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:47.688348 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 36/65] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:24:47.697118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505944ad-734d-42b9-a512-4d83f2bd00c7 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:47.697525 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505944ad-734d-42b9-a512-4d83f2bd00c7 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:47.697886 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505944ad-734d-42b9-a512-4d83f2bd00c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:47.733465 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-505944ad-734d-42b9-a512-4d83f2bd00c7 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:47.734882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-505944ad-734d-42b9-a512-4d83f2bd00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:47.785559 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 30/66] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:47.861142 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 37/67] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:24:47.927706 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb0d48-a477-419d-82ff-2db5d7ebdaf5 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:47.927947 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb0d48-a477-419d-82ff-2db5d7ebdaf5 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:47.928265 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb0d48-a477-419d-82ff-2db5d7ebdaf5 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:47.929533 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 31/68] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:47.935793 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac324e-7d85-43b5-b1b9-098dbf4cb589 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:47.936131 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac324e-7d85-43b5-b1b9-098dbf4cb589 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:47.936394 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac324e-7d85-43b5-b1b9-098dbf4cb589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:47.973722 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-68ac324e-7d85-43b5-b1b9-098dbf4cb589 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:47.974954 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-68ac324e-7d85-43b5-b1b9-098dbf4cb589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:48.088220 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 38/69] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:48.126807 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb0d48-a477-419d-82ff-2db5d7ebdaf5 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:48.190528 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac324e-7d85-43b5-b1b9-098dbf4cb589 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:48.219941 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:48.254496 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb0d48-a477-419d-82ff-2db5d7ebdaf5 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:48.266618 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:48.292360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478e69d-8f1d-47d4-9d23-7254741dd259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:48.293413 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478e69d-8f1d-47d4-9d23-7254741dd259 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:48.293863 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478e69d-8f1d-47d4-9d23-7254741dd259 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:48.294202 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478e69d-8f1d-47d4-9d23-7254741dd259 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:48.308437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478e69d-8f1d-47d4-9d23-7254741dd259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-1478e69d-8f1d-47d4-9d23-7254741dd259 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:24:48.315869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:48.318283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 32/70] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:24:48.320696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478e69d-8f1d-47d4-9d23-7254741dd259 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:48.346419 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac324e-7d85-43b5-b1b9-098dbf4cb589 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:48.389732 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5b5fe-82cc-4faa-8688-6864638261ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:48.390372 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5b5fe-82cc-4faa-8688-6864638261ad None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:48.390650 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5b5fe-82cc-4faa-8688-6864638261ad None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:48.390918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5b5fe-82cc-4faa-8688-6864638261ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:48.404684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5b5fe-82cc-4faa-8688-6864638261ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-b6b5b5fe-82cc-4faa-8688-6864638261ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:24:48.410523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:48.411607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:48.412472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:48.412472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:48.412472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:48.412472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:48.412472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:24:48.412472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:24:48.412472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:24:48.412472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:24:48.412472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:24:48.412472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:24:48.412472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:24:48.412472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:24:48.412472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 39/71] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:24:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:24:48.413162 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ff7ec-9fe3-4ed0-aa3f-f910cc19500c None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:48.422240 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ff7ec-9fe3-4ed0-aa3f-f910cc19500c None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:48.422240 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ff7ec-9fe3-4ed0-aa3f-f910cc19500c None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:48.422240 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 40/72] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:48.422240 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ff7ec-9fe3-4ed0-aa3f-f910cc19500c None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:48.468759 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478e69d-8f1d-47d4-9d23-7254741dd259 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:48.504726 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:48.527964 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d6c0e-5f57-4435-a4b8-29009ef63f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:48.529020 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d6c0e-5f57-4435-a4b8-29009ef63f8f None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:48.529549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d6c0e-5f57-4435-a4b8-29009ef63f8f None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:48.530024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d6c0e-5f57-4435-a4b8-29009ef63f8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:48.547616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d6c0e-5f57-4435-a4b8-29009ef63f8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:24:48.551093 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:48.555932 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ff7ec-9fe3-4ed0-aa3f-f910cc19500c None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-878d6c0e-5f57-4435-a4b8-29009ef63f8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:24:48.556771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:48.557769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:48.558715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:48.558715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:48.558715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:48.558715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:48.558715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:24:48.558715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:24:48.558715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:24:48.558715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:24:48.558715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:24:48.558715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:24:48.558715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:24:48.558715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:24:48.558715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 33/73] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:24:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:24:48.560087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d6c0e-5f57-4435-a4b8-29009ef63f8f None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:48.593812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfaf05-382e-4c05-9756-cebc2a04f1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:48.594429 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfaf05-382e-4c05-9756-cebc2a04f1db None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:48.594714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfaf05-382e-4c05-9756-cebc2a04f1db None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:48.594992 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfaf05-382e-4c05-9756-cebc2a04f1db None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:48.595750 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfaf05-382e-4c05-9756-cebc2a04f1db None admin] RBAC: Adding query filter params (name=admin) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:48.596164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfaf05-382e-4c05-9756-cebc2a04f1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:48.597536 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfaf05-382e-4c05-9756-cebc2a04f1db None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:48.609571 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 41/74] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:24:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:48.612114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1fe5d-cf54-4d02-b325-bcffe39f3daf None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:48.612227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1fe5d-cf54-4d02-b325-bcffe39f3daf None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:48.613299 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1fe5d-cf54-4d02-b325-bcffe39f3daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:48.640424 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-64a1fe5d-cf54-4d02-b325-bcffe39f3daf None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:48.642163 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-64a1fe5d-cf54-4d02-b325-bcffe39f3daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:48.698022 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d6c0e-5f57-4435-a4b8-29009ef63f8f None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:48.717753 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 42/75] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:48.718936 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1fe5d-cf54-4d02-b325-bcffe39f3daf None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:48.739261 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0ba06-decb-46f8-9e20-2b77db0dc6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:48.739917 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0ba06-decb-46f8-9e20-2b77db0dc6af None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:48.740251 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0ba06-decb-46f8-9e20-2b77db0dc6af None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:48.740491 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0ba06-decb-46f8-9e20-2b77db0dc6af None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:48.741190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0ba06-decb-46f8-9e20-2b77db0dc6af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:48.741494 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0ba06-decb-46f8-9e20-2b77db0dc6af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:48.742961 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0ba06-decb-46f8-9e20-2b77db0dc6af None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:48.758677 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 34/76] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:24:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:48.759561 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0ba06-decb-46f8-9e20-2b77db0dc6af None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:48.818485 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:48.852788 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:48.864958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1fe5d-cf54-4d02-b325-bcffe39f3daf None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:48.893354 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0ba06-decb-46f8-9e20-2b77db0dc6af None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:48.905834 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a78e2-1f18-40ab-a730-6584a6bcf0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:48.906555 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a78e2-1f18-40ab-a730-6584a6bcf0eb None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:48.906877 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a78e2-1f18-40ab-a730-6584a6bcf0eb None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:48.907381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a78e2-1f18-40ab-a730-6584a6bcf0eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:48.908446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a78e2-1f18-40ab-a730-6584a6bcf0eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:48.909877 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a78e2-1f18-40ab-a730-6584a6bcf0eb None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:48.911542 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 43/77] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:24:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:48.912272 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a78e2-1f18-40ab-a730-6584a6bcf0eb None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:48.942315 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0671b17-e892-4ba3-8327-db819add58cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:48.943256 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0671b17-e892-4ba3-8327-db819add58cf None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:48.943661 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0671b17-e892-4ba3-8327-db819add58cf None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:48.944060 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0671b17-e892-4ba3-8327-db819add58cf None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:48.944953 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0671b17-e892-4ba3-8327-db819add58cf None admin] RBAC: Adding query filter params (name=member) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:48.945466 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0671b17-e892-4ba3-8327-db819add58cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:48.947118 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0671b17-e892-4ba3-8327-db819add58cf None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:48.963207 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 35/78] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:24:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:48.963207 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0671b17-e892-4ba3-8327-db819add58cf None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:49.038608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a78e2-1f18-40ab-a730-6584a6bcf0eb None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:49.077476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4a046-b7c3-4189-8212-b386e1fd71f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:49.078119 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4a046-b7c3-4189-8212-b386e1fd71f5 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:49.078399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4a046-b7c3-4189-8212-b386e1fd71f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:49.078672 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4a046-b7c3-4189-8212-b386e1fd71f5 None admin] PATH_INFO: `/v3/users/b441ea8946b74edd833bbf63322f9350` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:49.079872 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4a046-b7c3-4189-8212-b386e1fd71f5 None admin] RBAC: Authorizing `identity:get_user(user_id=b441ea8946b74edd833bbf63322f9350)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:49.081333 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4a046-b7c3-4189-8212-b386e1fd71f5 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:49.083149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 44/79] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:24:48 2022] GET /identity/v3/users/b441ea8946b74edd833bbf63322f9350 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:49.083731 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4a046-b7c3-4189-8212-b386e1fd71f5 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:49.090244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0671b17-e892-4ba3-8327-db819add58cf None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:49.093516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:49.112888 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:49.129550 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95e596-9a68-4f8f-ae28-dba86df19553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:49.130194 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95e596-9a68-4f8f-ae28-dba86df19553 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:49.130483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95e596-9a68-4f8f-ae28-dba86df19553 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:49.130765 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95e596-9a68-4f8f-ae28-dba86df19553 None admin] PATH_INFO: `/v3/users/c335a23dde39460b97b39ea387e956fb` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:49.146594 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95e596-9a68-4f8f-ae28-dba86df19553 None admin] RBAC: Authorizing `identity:get_user(user_id=c335a23dde39460b97b39ea387e956fb)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:49.149475 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95e596-9a68-4f8f-ae28-dba86df19553 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:49.157518 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 36/80] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:24:48 2022] GET /identity/v3/users/c335a23dde39460b97b39ea387e956fb => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:49.157518 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95e596-9a68-4f8f-ae28-dba86df19553 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:49.201382 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4a046-b7c3-4189-8212-b386e1fd71f5 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:49.240000 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea069dc0-673d-4ec4-b461-6081592513f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:49.240617 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea069dc0-673d-4ec4-b461-6081592513f5 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:49.240948 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea069dc0-673d-4ec4-b461-6081592513f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:49.241234 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea069dc0-673d-4ec4-b461-6081592513f5 None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:49.241879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea069dc0-673d-4ec4-b461-6081592513f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:49.243380 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea069dc0-673d-4ec4-b461-6081592513f5 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:49.266921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95e596-9a68-4f8f-ae28-dba86df19553 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:49.302290 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358bf2a-9abc-412d-bf5c-94286c32fd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:49.302856 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358bf2a-9abc-412d-bf5c-94286c32fd6e None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:49.303156 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358bf2a-9abc-412d-bf5c-94286c32fd6e None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:49.308989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358bf2a-9abc-412d-bf5c-94286c32fd6e None admin] PATH_INFO: `/v3/users/c335a23dde39460b97b39ea387e956fb` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:49.308989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358bf2a-9abc-412d-bf5c-94286c32fd6e None admin] RBAC: Authorizing `identity:get_user(user_id=c335a23dde39460b97b39ea387e956fb)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:49.308989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358bf2a-9abc-412d-bf5c-94286c32fd6e None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:49.308989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 37/81] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:24:49 2022] GET /identity/v3/users/c335a23dde39460b97b39ea387e956fb => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:49.308989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358bf2a-9abc-412d-bf5c-94286c32fd6e None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:49.333949 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 45/82] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Aug 23 16:24:49 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:24:49.334889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea069dc0-673d-4ec4-b461-6081592513f5 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:49.340053 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:49.449660 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358bf2a-9abc-412d-bf5c-94286c32fd6e None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:49.494642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:49.514391 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b934e-c9bd-459f-903c-39ac5ea17cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:49.515495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b934e-c9bd-459f-903c-39ac5ea17cfe None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:49.515922 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b934e-c9bd-459f-903c-39ac5ea17cfe None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:49.516374 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b934e-c9bd-459f-903c-39ac5ea17cfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:49.525716 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea069dc0-673d-4ec4-b461-6081592513f5 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:49.536135 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b934e-c9bd-459f-903c-39ac5ea17cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-548b934e-c9bd-459f-903c-39ac5ea17cfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:24:49.543076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:49.544094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:49.545244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:49.545244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:49.545244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:49.545244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:49.545244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:24:49.545244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:24:49.545244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:24:49.545244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:24:49.545244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:24:49.545244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:24:49.545244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:24:49.545244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:24:49.545999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 38/83] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:24:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:24:49.547034 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b934e-c9bd-459f-903c-39ac5ea17cfe None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:49.586191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f3275-39d7-46ff-aaf7-e2b36bd793c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:49.586824 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f3275-39d7-46ff-aaf7-e2b36bd793c5 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:49.587179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f3275-39d7-46ff-aaf7-e2b36bd793c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:49.587698 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f3275-39d7-46ff-aaf7-e2b36bd793c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:49.701932 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f3275-39d7-46ff-aaf7-e2b36bd793c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:49.703519 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f3275-39d7-46ff-aaf7-e2b36bd793c5 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:49.720721 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:49.740033 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b934e-c9bd-459f-903c-39ac5ea17cfe None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:49.787364 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c08cce-ab88-42ae-9885-e81cefe08b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:49.788618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c08cce-ab88-42ae-9885-e81cefe08b86 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:49.789574 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c08cce-ab88-42ae-9885-e81cefe08b86 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:49.790322 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c08cce-ab88-42ae-9885-e81cefe08b86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:49.817892 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:49.840942 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 46/84] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:24:49.842396 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f3275-39d7-46ff-aaf7-e2b36bd793c5 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:49.891540 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c08cce-ab88-42ae-9885-e81cefe08b86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:49.893704 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c08cce-ab88-42ae-9885-e81cefe08b86 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:49.964104 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f3275-39d7-46ff-aaf7-e2b36bd793c5 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.010563 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b2552-56ec-49a6-b57e-3d0cb19f8cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.011677 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b2552-56ec-49a6-b57e-3d0cb19f8cac None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.012471 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b2552-56ec-49a6-b57e-3d0cb19f8cac None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.013089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b2552-56ec-49a6-b57e-3d0cb19f8cac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.022073 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:50.040094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 39/85] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:24:50.041869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c08cce-ab88-42ae-9885-e81cefe08b86 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.122728 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:50.159647 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b2552-56ec-49a6-b57e-3d0cb19f8cac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.164790 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b2552-56ec-49a6-b57e-3d0cb19f8cac None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.175905 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c08cce-ab88-42ae-9885-e81cefe08b86 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.223876 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e4c93-a360-4fc8-ba67-d19841ceffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.224745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4c93-a360-4fc8-ba67-d19841ceffd8 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.225200 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4c93-a360-4fc8-ba67-d19841ceffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.225621 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4c93-a360-4fc8-ba67-d19841ceffd8 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.226464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4c93-a360-4fc8-ba67-d19841ceffd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:50.226922 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4c93-a360-4fc8-ba67-d19841ceffd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.228527 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4c93-a360-4fc8-ba67-d19841ceffd8 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.238440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 40/86] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:24:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:50.239626 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e4c93-a360-4fc8-ba67-d19841ceffd8 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.302919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 47/87] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:24:50.304029 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:50.304900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b2552-56ec-49a6-b57e-3d0cb19f8cac None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.364242 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e4c93-a360-4fc8-ba67-d19841ceffd8 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.401557 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:50.423451 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b2552-56ec-49a6-b57e-3d0cb19f8cac None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.428354 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea49909-06d6-47c4-9a6d-2f4964ab7987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.429446 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea49909-06d6-47c4-9a6d-2f4964ab7987 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.430160 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea49909-06d6-47c4-9a6d-2f4964ab7987 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.430677 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea49909-06d6-47c4-9a6d-2f4964ab7987 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.432785 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea49909-06d6-47c4-9a6d-2f4964ab7987 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.435548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea49909-06d6-47c4-9a6d-2f4964ab7987 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.439368 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 41/88] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:24:50 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:50.440249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea49909-06d6-47c4-9a6d-2f4964ab7987 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.495650 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731478c-7755-4b19-982b-e8c8e78841e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.496774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731478c-7755-4b19-982b-e8c8e78841e1 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.497287 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731478c-7755-4b19-982b-e8c8e78841e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.497760 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731478c-7755-4b19-982b-e8c8e78841e1 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.499747 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731478c-7755-4b19-982b-e8c8e78841e1 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.502354 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731478c-7755-4b19-982b-e8c8e78841e1 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.505905 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 48/89] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:24:50 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:50.515859 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731478c-7755-4b19-982b-e8c8e78841e1 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.560569 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea49909-06d6-47c4-9a6d-2f4964ab7987 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.582233 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:50.599086 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b031f9-b444-4702-a9a7-000e0e409bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.600016 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b031f9-b444-4702-a9a7-000e0e409bff None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.600442 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b031f9-b444-4702-a9a7-000e0e409bff None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.600915 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b031f9-b444-4702-a9a7-000e0e409bff None admin] PATH_INFO: `/v3/users/c335a23dde39460b97b39ea387e956fb` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.602362 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b031f9-b444-4702-a9a7-000e0e409bff None admin] RBAC: Authorizing `identity:get_user(user_id=c335a23dde39460b97b39ea387e956fb)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.604026 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b031f9-b444-4702-a9a7-000e0e409bff None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.605903 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 42/90] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:24:50 2022] GET /identity/v3/users/c335a23dde39460b97b39ea387e956fb => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:50.606968 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b031f9-b444-4702-a9a7-000e0e409bff None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.670512 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731478c-7755-4b19-982b-e8c8e78841e1 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.722466 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b031f9-b444-4702-a9a7-000e0e409bff None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.733892 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334221b7-1869-4f55-8267-590f2a4d8df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.735005 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334221b7-1869-4f55-8267-590f2a4d8df6 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.735688 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334221b7-1869-4f55-8267-590f2a4d8df6 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.736079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334221b7-1869-4f55-8267-590f2a4d8df6 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.738540 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334221b7-1869-4f55-8267-590f2a4d8df6 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.741283 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334221b7-1869-4f55-8267-590f2a4d8df6 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.744534 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 49/91] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:24:50 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:50.750417 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334221b7-1869-4f55-8267-590f2a4d8df6 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.773463 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475d0bb-e7a5-442e-bbf1-66185947e486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.774300 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475d0bb-e7a5-442e-bbf1-66185947e486 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.774770 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475d0bb-e7a5-442e-bbf1-66185947e486 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.775184 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475d0bb-e7a5-442e-bbf1-66185947e486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.776101 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475d0bb-e7a5-442e-bbf1-66185947e486 None admin] RBAC: Adding query filter params (role.id=091802a86e334e129210219b7c69359d, scope.project.id=39c3c57ed064477baba507d8cda5eee4, user.id=b441ea8946b74edd833bbf63322f9350) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:50.776611 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475d0bb-e7a5-442e-bbf1-66185947e486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.778285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475d0bb-e7a5-442e-bbf1-66185947e486 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.785476 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 43/92] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:24:50 2022] GET /identity/v3/role_assignments?user.id=b441ea8946b74edd833bbf63322f9350&scope.project.id=39c3c57ed064477baba507d8cda5eee4&role.id=091802a86e334e129210219b7c69359d => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:50.786736 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475d0bb-e7a5-442e-bbf1-66185947e486 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.799944 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:50.854501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:50.915458 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475d0bb-e7a5-442e-bbf1-66185947e486 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.957835 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd179b-bc74-4aae-a4c0-a01d0f0dfaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.958839 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd179b-bc74-4aae-a4c0-a01d0f0dfaab None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.959371 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd179b-bc74-4aae-a4c0-a01d0f0dfaab None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.959832 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334221b7-1869-4f55-8267-590f2a4d8df6 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.960075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd179b-bc74-4aae-a4c0-a01d0f0dfaab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.999756 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0239b-3db7-4dc8-888b-329123ae4809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:51.000386 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0239b-3db7-4dc8-888b-329123ae4809 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:51.000670 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0239b-3db7-4dc8-888b-329123ae4809 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:51.000947 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0239b-3db7-4dc8-888b-329123ae4809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:51.001684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0239b-3db7-4dc8-888b-329123ae4809 None admin] RBAC: Adding query filter params (role.id=1f86135571074da38ac7d898436a8862, scope.project.id=39c3c57ed064477baba507d8cda5eee4, user.id=c335a23dde39460b97b39ea387e956fb) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:51.001998 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0239b-3db7-4dc8-888b-329123ae4809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:51.004126 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0239b-3db7-4dc8-888b-329123ae4809 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:51.012200 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 50/93] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:24:50 2022] GET /identity/v3/role_assignments?user.id=c335a23dde39460b97b39ea387e956fb&scope.project.id=39c3c57ed064477baba507d8cda5eee4&role.id=1f86135571074da38ac7d898436a8862 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:51.013091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0239b-3db7-4dc8-888b-329123ae4809 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:51.045622 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd179b-bc74-4aae-a4c0-a01d0f0dfaab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:51.047773 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd179b-bc74-4aae-a4c0-a01d0f0dfaab None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:51.110037 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:51.116594 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:51.131999 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0239b-3db7-4dc8-888b-329123ae4809 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:51.180375 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c22090-1343-458e-b1ed-c49bfa5cf49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:51.181021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c22090-1343-458e-b1ed-c49bfa5cf49a None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:51.181308 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c22090-1343-458e-b1ed-c49bfa5cf49a None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:51.181590 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c22090-1343-458e-b1ed-c49bfa5cf49a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:51.182353 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c22090-1343-458e-b1ed-c49bfa5cf49a None admin] RBAC: Adding query filter params (role.id=4bc1625db2f14e779d8acb4d21d9d3f1, scope.project.id=39c3c57ed064477baba507d8cda5eee4, user.id=c335a23dde39460b97b39ea387e956fb) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:51.182668 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c22090-1343-458e-b1ed-c49bfa5cf49a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:51.187255 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c22090-1343-458e-b1ed-c49bfa5cf49a None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:51.190963 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 51/94] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:24:51 2022] GET /identity/v3/role_assignments?user.id=c335a23dde39460b97b39ea387e956fb&scope.project.id=39c3c57ed064477baba507d8cda5eee4&role.id=4bc1625db2f14e779d8acb4d21d9d3f1 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:51.246082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 44/95] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:24:51.246658 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c22090-1343-458e-b1ed-c49bfa5cf49a None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:51.427464 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c22090-1343-458e-b1ed-c49bfa5cf49a None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:51.492212 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ecdbb-d8fb-4fb0-882c-771d09e5df34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:51.493235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ecdbb-d8fb-4fb0-882c-771d09e5df34 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:51.493711 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ecdbb-d8fb-4fb0-882c-771d09e5df34 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:51.494210 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ecdbb-d8fb-4fb0-882c-771d09e5df34 None admin] PATH_INFO: `/v3/projects/d3d75ef43ce540138519e2b9c96a0bb3` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:51.500208 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ecdbb-d8fb-4fb0-882c-771d09e5df34 None admin] RBAC: Authorizing `identity:get_project(project_id=d3d75ef43ce540138519e2b9c96a0bb3)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:51.502008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ecdbb-d8fb-4fb0-882c-771d09e5df34 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:51.503980 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 52/96] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:24:51 2022] GET /identity/v3/projects/d3d75ef43ce540138519e2b9c96a0bb3 => generated 312 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:51.510297 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd179b-bc74-4aae-a4c0-a01d0f0dfaab None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:51.739769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd179b-bc74-4aae-a4c0-a01d0f0dfaab None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:51.834915 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae36430-cf4f-4e48-a8f8-a5ebd463c63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:51.835599 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae36430-cf4f-4e48-a8f8-a5ebd463c63b None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:51.835888 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae36430-cf4f-4e48-a8f8-a5ebd463c63b None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:51.836169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae36430-cf4f-4e48-a8f8-a5ebd463c63b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:51.836922 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae36430-cf4f-4e48-a8f8-a5ebd463c63b None admin] RBAC: Adding query filter params (role.id=4bc1625db2f14e779d8acb4d21d9d3f1, scope.project.id=d3d75ef43ce540138519e2b9c96a0bb3, user.id=c335a23dde39460b97b39ea387e956fb) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:51.837239 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae36430-cf4f-4e48-a8f8-a5ebd463c63b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:51.838734 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae36430-cf4f-4e48-a8f8-a5ebd463c63b None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:51.846043 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 45/97] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:24:51 2022] GET /identity/v3/role_assignments?user.id=c335a23dde39460b97b39ea387e956fb&scope.project.id=d3d75ef43ce540138519e2b9c96a0bb3&role.id=4bc1625db2f14e779d8acb4d21d9d3f1 => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:52.509775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9fe68-2f2d-4f06-a4ff-6c07bdb9da0b None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:52.510814 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9fe68-2f2d-4f06-a4ff-6c07bdb9da0b None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:52.511325 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9fe68-2f2d-4f06-a4ff-6c07bdb9da0b None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:52.513122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 53/98] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:52.520345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6c957-9c2e-42cf-a118-3a9c8d07fe12 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:52.521292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6c957-9c2e-42cf-a118-3a9c8d07fe12 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:52.521821 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6c957-9c2e-42cf-a118-3a9c8d07fe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:52.548318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-d1e6c957-9c2e-42cf-a118-3a9c8d07fe12 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:52.549874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-d1e6c957-9c2e-42cf-a118-3a9c8d07fe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:52.563597 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:52.634407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 46/99] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:52.898375 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83028b23-1e73-43e3-8bf7-d515005d3dde None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:52.898749 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83028b23-1e73-43e3-8bf7-d515005d3dde None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:52.899009 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83028b23-1e73-43e3-8bf7-d515005d3dde None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:52.900554 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 54/100] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:52.906890 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ae66-9987-42a1-86b0-85afd92b4e23 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:52.907173 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ae66-9987-42a1-86b0-85afd92b4e23 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:52.907489 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ae66-9987-42a1-86b0-85afd92b4e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:52.936504 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-9382ae66-9987-42a1-86b0-85afd92b4e23 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:52.937726 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-9382ae66-9987-42a1-86b0-85afd92b4e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:53.042269 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 47/101] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:53.291924 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83028b23-1e73-43e3-8bf7-d515005d3dde None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:53.314102 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:53.428008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83028b23-1e73-43e3-8bf7-d515005d3dde None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:53.478258 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa02136-6aa1-4358-9f38-41369f7d2370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:53.479348 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa02136-6aa1-4358-9f38-41369f7d2370 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:53.479839 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa02136-6aa1-4358-9f38-41369f7d2370 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:53.480306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa02136-6aa1-4358-9f38-41369f7d2370 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:53.483999 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa02136-6aa1-4358-9f38-41369f7d2370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:53.485725 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa02136-6aa1-4358-9f38-41369f7d2370 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:53.488105 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 55/102] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:24:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:53.496387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382ae66-9987-42a1-86b0-85afd92b4e23 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:53.622683 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:53.649322 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382ae66-9987-42a1-86b0-85afd92b4e23 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:53.687810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7201dc-32f0-4430-85ff-b4739356d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:53.688459 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7201dc-32f0-4430-85ff-b4739356d8b7 None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:53.688815 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7201dc-32f0-4430-85ff-b4739356d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:53.689099 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7201dc-32f0-4430-85ff-b4739356d8b7 None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:53.689746 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7201dc-32f0-4430-85ff-b4739356d8b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:53.691320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7201dc-32f0-4430-85ff-b4739356d8b7 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:53.709827 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa02136-6aa1-4358-9f38-41369f7d2370 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:53.833044 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:53.838570 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 48/103] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Aug 23 16:24:53 2022] POST /identity/v3/projects => generated 302 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:24:53.863618 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa02136-6aa1-4358-9f38-41369f7d2370 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:53.916144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415177c-279b-4afd-8e26-1514914ab46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:53.917208 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415177c-279b-4afd-8e26-1514914ab46f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:53.917703 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415177c-279b-4afd-8e26-1514914ab46f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:53.918256 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415177c-279b-4afd-8e26-1514914ab46f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:53.931773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415177c-279b-4afd-8e26-1514914ab46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-3415177c-279b-4afd-8e26-1514914ab46f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:24:53.936864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:53.937754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:53.938548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:53.938548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:53.938548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:53.938548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:53.938548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:24:53.938548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:24:53.938548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:24:53.938548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:24:53.938548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:24:53.938548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:24:53.938548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:24:53.938548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:24:53.941337 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 56/104] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:24:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:24:53.947217 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7201dc-32f0-4430-85ff-b4739356d8b7 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:54.101924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7201dc-32f0-4430-85ff-b4739356d8b7 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:54.144079 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:54.153531 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf2682-162d-40bf-94de-05ce88e233fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:54.154156 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf2682-162d-40bf-94de-05ce88e233fc None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:54.155254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf2682-162d-40bf-94de-05ce88e233fc None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:54.168178 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf2682-162d-40bf-94de-05ce88e233fc None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:54.168178 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf2682-162d-40bf-94de-05ce88e233fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:54.168178 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf2682-162d-40bf-94de-05ce88e233fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:54.168178 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf2682-162d-40bf-94de-05ce88e233fc None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:54.173450 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 49/105] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:24:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:54.180134 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415177c-279b-4afd-8e26-1514914ab46f None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:54.329922 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415177c-279b-4afd-8e26-1514914ab46f None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:54.374521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e8b63-a396-4088-a8b7-87911da22cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:54.375169 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e8b63-a396-4088-a8b7-87911da22cdd None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:54.375490 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e8b63-a396-4088-a8b7-87911da22cdd None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:54.375765 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e8b63-a396-4088-a8b7-87911da22cdd None admin] PATH_INFO: `/v3/users/843d300923b8449aa6452cbe47210f37` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:54.394073 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:54.397148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e8b63-a396-4088-a8b7-87911da22cdd None admin] RBAC: Authorizing `identity:get_user(user_id=843d300923b8449aa6452cbe47210f37)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:54.398902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e8b63-a396-4088-a8b7-87911da22cdd None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:54.400809 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 57/106] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:24:54 2022] GET /identity/v3/users/843d300923b8449aa6452cbe47210f37 => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:54.406360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf2682-162d-40bf-94de-05ce88e233fc None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:54.460117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c75484-e471-4883-8003-129438ae7147 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:54.460352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c75484-e471-4883-8003-129438ae7147 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:54.460642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c75484-e471-4883-8003-129438ae7147 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:54.462189 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 58/107] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:24:54.465777 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98903d6f-dc8d-449b-b3b4-61925cd880d6 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:54.466116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98903d6f-dc8d-449b-b3b4-61925cd880d6 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:54.466375 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98903d6f-dc8d-449b-b3b4-61925cd880d6 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:54.468898 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 59/108] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:24:54.473845 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e41a29-afe2-4bf8-a298-d0142a78b2eb None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:54.474202 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e41a29-afe2-4bf8-a298-d0142a78b2eb None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:54.474401 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e41a29-afe2-4bf8-a298-d0142a78b2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:54.507157 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-37e41a29-afe2-4bf8-a298-d0142a78b2eb None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:54.512710 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-37e41a29-afe2-4bf8-a298-d0142a78b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:54.541031 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf2682-162d-40bf-94de-05ce88e233fc None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:54.602185 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d0cd3-2b8f-42cb-8ad5-27d8fbcb97c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:54.603065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d0cd3-2b8f-42cb-8ad5-27d8fbcb97c8 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:54.603938 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d0cd3-2b8f-42cb-8ad5-27d8fbcb97c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:54.604226 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d0cd3-2b8f-42cb-8ad5-27d8fbcb97c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:54.620603 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 60/109] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:24:54.624460 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b0a84-6d95-416b-ae47-0e971dc790e2 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:54.627122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b0a84-6d95-416b-ae47-0e971dc790e2 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:54.627122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b0a84-6d95-416b-ae47-0e971dc790e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:54.665731 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-050b0a84-6d95-416b-ae47-0e971dc790e2 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:54.666968 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-050b0a84-6d95-416b-ae47-0e971dc790e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:54.730827 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:54.751055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d0cd3-2b8f-42cb-8ad5-27d8fbcb97c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:54.752642 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d0cd3-2b8f-42cb-8ad5-27d8fbcb97c8 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:54.817741 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 61/110] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:54.902357 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 50/111] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:24:54.908240 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b0a84-6d95-416b-ae47-0e971dc790e2 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:54.980047 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:55.028396 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edb01b-7816-44d8-8262-8cdd02b86cbc None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:55.028750 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edb01b-7816-44d8-8262-8cdd02b86cbc None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:55.028989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edb01b-7816-44d8-8262-8cdd02b86cbc None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:55.031265 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 51/112] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:55.041166 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b0a84-6d95-416b-ae47-0e971dc790e2 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:55.044407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da215bd0-4ff8-49bb-aaa2-804775eeb6c8 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:55.044688 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da215bd0-4ff8-49bb-aaa2-804775eeb6c8 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:55.045524 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da215bd0-4ff8-49bb-aaa2-804775eeb6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:55.076497 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-da215bd0-4ff8-49bb-aaa2-804775eeb6c8 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:55.077742 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-da215bd0-4ff8-49bb-aaa2-804775eeb6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:55.130404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b9f2-da5a-42f9-a874-f3650ae9a18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:55.131002 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b9f2-da5a-42f9-a874-f3650ae9a18f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:55.131310 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b9f2-da5a-42f9-a874-f3650ae9a18f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:55.131589 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b9f2-da5a-42f9-a874-f3650ae9a18f None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:55.134400 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b9f2-da5a-42f9-a874-f3650ae9a18f None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:55.135919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b9f2-da5a-42f9-a874-f3650ae9a18f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:55.137774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 62/113] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:24:54 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:55.138401 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b9f2-da5a-42f9-a874-f3650ae9a18f None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:55.228109 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 52/114] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:24:55.228844 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da215bd0-4ff8-49bb-aaa2-804775eeb6c8 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:55.280231 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:55.302690 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b9f2-da5a-42f9-a874-f3650ae9a18f None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:55.344873 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:55.353435 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefbd46-6ab2-4e87-91ff-507640572426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:55.358212 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefbd46-6ab2-4e87-91ff-507640572426 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:55.358212 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefbd46-6ab2-4e87-91ff-507640572426 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:55.358212 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefbd46-6ab2-4e87-91ff-507640572426 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:55.367434 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefbd46-6ab2-4e87-91ff-507640572426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-6eefbd46-6ab2-4e87-91ff-507640572426 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:24:55.372852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:55.373918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:55.374755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:55.374755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:55.374755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:55.374755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:55.374755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:24:55.374755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:24:55.374755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:24:55.374755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:24:55.374755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:24:55.374755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:24:55.374755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:24:55.374755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:24:55.375359 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 63/115] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:24:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:24:55.379097 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da215bd0-4ff8-49bb-aaa2-804775eeb6c8 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:55.382937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a667d-995d-4073-9a80-10082761e5e4 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:55.383376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a667d-995d-4073-9a80-10082761e5e4 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:55.383918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a667d-995d-4073-9a80-10082761e5e4 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:55.385576 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 64/116] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:55.386397 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a667d-995d-4073-9a80-10082761e5e4 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:55.425461 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76290b45-f849-41bc-8040-f8db2183fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:55.426083 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76290b45-f849-41bc-8040-f8db2183fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:55.426359 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76290b45-f849-41bc-8040-f8db2183fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:55.426638 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76290b45-f849-41bc-8040-f8db2183fdb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:55.427499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76290b45-f849-41bc-8040-f8db2183fdb7 None admin] RBAC: Adding query filter params (role.id=225f2a2bd302418485ac34ecb871c3e4, scope.project.id=39c3c57ed064477baba507d8cda5eee4, user.id=843d300923b8449aa6452cbe47210f37) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:55.427721 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76290b45-f849-41bc-8040-f8db2183fdb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:55.429244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76290b45-f849-41bc-8040-f8db2183fdb7 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:55.435654 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 53/117] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:24:55 2022] GET /identity/v3/role_assignments?user.id=843d300923b8449aa6452cbe47210f37&scope.project.id=39c3c57ed064477baba507d8cda5eee4&role.id=225f2a2bd302418485ac34ecb871c3e4 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:55.439799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76290b45-f849-41bc-8040-f8db2183fdb7 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:55.550813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:55.569875 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76290b45-f849-41bc-8040-f8db2183fdb7 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:55.615188 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84141909-89df-432a-b395-867f484168c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:55.620316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141909-89df-432a-b395-867f484168c0 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:55.620666 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141909-89df-432a-b395-867f484168c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:55.620981 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141909-89df-432a-b395-867f484168c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:55.621710 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84141909-89df-432a-b395-867f484168c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:55.622029 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84141909-89df-432a-b395-867f484168c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:55.624597 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84141909-89df-432a-b395-867f484168c0 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:55.628134 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a667d-995d-4073-9a80-10082761e5e4 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:55.650351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 54/118] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:24:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:55.652100 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ead507-b1b8-471e-aa83-3f5eb84710e2 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:55.652575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ead507-b1b8-471e-aa83-3f5eb84710e2 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:55.652982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ead507-b1b8-471e-aa83-3f5eb84710e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:55.676169 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673592e5-8b23-43a4-b11c-d219d92f9583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:55.676827 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673592e5-8b23-43a4-b11c-d219d92f9583 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:55.677107 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673592e5-8b23-43a4-b11c-d219d92f9583 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:55.677387 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673592e5-8b23-43a4-b11c-d219d92f9583 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:55.678256 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-70ead507-b1b8-471e-aa83-3f5eb84710e2 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:55.679820 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-70ead507-b1b8-471e-aa83-3f5eb84710e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:55.694483 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673592e5-8b23-43a4-b11c-d219d92f9583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-673592e5-8b23-43a4-b11c-d219d92f9583 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:24:55.704521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:55.708284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 65/119] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:24:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:24:55.709036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673592e5-8b23-43a4-b11c-d219d92f9583 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:55.793460 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 55/120] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:55.798998 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ead507-b1b8-471e-aa83-3f5eb84710e2 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:55.823946 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:55.943603 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673592e5-8b23-43a4-b11c-d219d92f9583 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:55.990541 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adb35d-3841-4563-a868-7e5ea788ed27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:55.991634 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adb35d-3841-4563-a868-7e5ea788ed27 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:55.992124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adb35d-3841-4563-a868-7e5ea788ed27 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:55.992628 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adb35d-3841-4563-a868-7e5ea788ed27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:56.008097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26adb35d-3841-4563-a868-7e5ea788ed27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-26adb35d-3841-4563-a868-7e5ea788ed27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:24:56.015114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:56.016070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:56.016802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:56.016802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:56.016802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:56.016802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:56.016802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:24:56.016802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:24:56.016802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:24:56.016802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:24:56.016802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:24:56.016802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:24:56.016802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:24:56.016802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:24:56.024360 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 66/121] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:24:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:24:56.024360 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adb35d-3841-4563-a868-7e5ea788ed27 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:56.039651 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:56.126914 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ead507-b1b8-471e-aa83-3f5eb84710e2 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:56.161681 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adb35d-3841-4563-a868-7e5ea788ed27 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:56.173483 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:56.203959 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430dd8-ad42-4a48-92a9-93b383f66889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:56.204859 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430dd8-ad42-4a48-92a9-93b383f66889 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:56.205282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430dd8-ad42-4a48-92a9-93b383f66889 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:56.205689 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430dd8-ad42-4a48-92a9-93b383f66889 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:56.206494 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68430dd8-ad42-4a48-92a9-93b383f66889 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:56.206936 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68430dd8-ad42-4a48-92a9-93b383f66889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:56.208540 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68430dd8-ad42-4a48-92a9-93b383f66889 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:56.218689 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 67/122] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:24:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:56.219990 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430dd8-ad42-4a48-92a9-93b383f66889 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:56.246321 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86c243-8875-4611-b3e0-2fbab2d59ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:56.247001 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c243-8875-4611-b3e0-2fbab2d59ea3 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:56.247364 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c243-8875-4611-b3e0-2fbab2d59ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:56.247634 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c243-8875-4611-b3e0-2fbab2d59ea3 None admin] PATH_INFO: `/v3/users/c335a23dde39460b97b39ea387e956fb` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:56.249604 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86c243-8875-4611-b3e0-2fbab2d59ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=c335a23dde39460b97b39ea387e956fb)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:56.251135 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86c243-8875-4611-b3e0-2fbab2d59ea3 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:56.253000 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 56/123] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:24:55 2022] GET /identity/v3/users/c335a23dde39460b97b39ea387e956fb => generated 275 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:56.253652 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86c243-8875-4611-b3e0-2fbab2d59ea3 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:56.353689 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430dd8-ad42-4a48-92a9-93b383f66889 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:56.398009 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12215499-92b1-43fe-ad87-818ce43afa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:56.399132 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12215499-92b1-43fe-ad87-818ce43afa81 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:56.399850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12215499-92b1-43fe-ad87-818ce43afa81 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:56.400286 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12215499-92b1-43fe-ad87-818ce43afa81 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:56.401187 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12215499-92b1-43fe-ad87-818ce43afa81 None admin] RBAC: Adding query filter params (name=member) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:56.401633 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12215499-92b1-43fe-ad87-818ce43afa81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:56.403479 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12215499-92b1-43fe-ad87-818ce43afa81 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:56.414562 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 68/124] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:24:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:56.421300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12215499-92b1-43fe-ad87-818ce43afa81 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:56.435165 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86c243-8875-4611-b3e0-2fbab2d59ea3 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:56.473552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:56.486053 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed79782-ab3f-4051-a8ee-4388c1b3b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:56.487591 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed79782-ab3f-4051-a8ee-4388c1b3b3f2 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:56.488178 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed79782-ab3f-4051-a8ee-4388c1b3b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:56.489066 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed79782-ab3f-4051-a8ee-4388c1b3b3f2 None admin] PATH_INFO: `/v3/users/b441ea8946b74edd833bbf63322f9350` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:56.490925 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed79782-ab3f-4051-a8ee-4388c1b3b3f2 None admin] RBAC: Authorizing `identity:get_user(user_id=b441ea8946b74edd833bbf63322f9350)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:56.493976 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed79782-ab3f-4051-a8ee-4388c1b3b3f2 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:56.496362 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 57/125] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:24:56 2022] GET /identity/v3/users/b441ea8946b74edd833bbf63322f9350 => generated 247 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:56.497351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed79782-ab3f-4051-a8ee-4388c1b3b3f2 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:56.521924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:56.571788 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12215499-92b1-43fe-ad87-818ce43afa81 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:56.613809 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f300350-5ddc-48b9-bdcd-a6bfcf551704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:56.614579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f300350-5ddc-48b9-bdcd-a6bfcf551704 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:56.615407 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f300350-5ddc-48b9-bdcd-a6bfcf551704 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:56.615407 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f300350-5ddc-48b9-bdcd-a6bfcf551704 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:56.629142 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f300350-5ddc-48b9-bdcd-a6bfcf551704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:24:56.635913 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed79782-ab3f-4051-a8ee-4388c1b3b3f2 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-3f300350-5ddc-48b9-bdcd-a6bfcf551704 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:24:56.636928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:56.638057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:56.639041 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:56.639041 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:56.639041 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:56.639041 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:56.639041 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:24:56.639041 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:24:56.639041 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:24:56.639041 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:24:56.639041 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:24:56.639041 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:24:56.639041 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:24:56.639041 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:24:56.643596 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 69/126] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:24:56.644888 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f300350-5ddc-48b9-bdcd-a6bfcf551704 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:56.680349 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d111b04-2e90-4c69-888a-a30d808e4c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:56.681283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d111b04-2e90-4c69-888a-a30d808e4c10 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:56.681706 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d111b04-2e90-4c69-888a-a30d808e4c10 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:56.682178 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d111b04-2e90-4c69-888a-a30d808e4c10 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:56.683746 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d111b04-2e90-4c69-888a-a30d808e4c10 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:56.685468 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d111b04-2e90-4c69-888a-a30d808e4c10 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:56.687841 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 58/127] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:24:56 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:56.689143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d111b04-2e90-4c69-888a-a30d808e4c10 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:56.781276 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:56.793409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f300350-5ddc-48b9-bdcd-a6bfcf551704 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:56.828845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:56.851360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d111b04-2e90-4c69-888a-a30d808e4c10 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:56.861588 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b943f6-0e60-447f-a16d-8441bf92f4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:56.864370 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b943f6-0e60-447f-a16d-8441bf92f4cc None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:56.865794 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b943f6-0e60-447f-a16d-8441bf92f4cc None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:56.867113 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b943f6-0e60-447f-a16d-8441bf92f4cc None admin] PATH_INFO: `/v3/users/c335a23dde39460b97b39ea387e956fb` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:56.870998 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b943f6-0e60-447f-a16d-8441bf92f4cc None admin] RBAC: Authorizing `identity:get_user(user_id=c335a23dde39460b97b39ea387e956fb)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:56.875178 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b943f6-0e60-447f-a16d-8441bf92f4cc None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:56.879766 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 70/128] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:24:56 2022] GET /identity/v3/users/c335a23dde39460b97b39ea387e956fb => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:56.882149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b943f6-0e60-447f-a16d-8441bf92f4cc None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:56.913491 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346257b-ad4a-420b-91f0-ed0490b039d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:56.914640 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346257b-ad4a-420b-91f0-ed0490b039d6 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:56.915409 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346257b-ad4a-420b-91f0-ed0490b039d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:56.916138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346257b-ad4a-420b-91f0-ed0490b039d6 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:56.918801 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346257b-ad4a-420b-91f0-ed0490b039d6 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:56.921636 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346257b-ad4a-420b-91f0-ed0490b039d6 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:56.925527 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 59/129] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:24:56 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:56.927039 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346257b-ad4a-420b-91f0-ed0490b039d6 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:57.027170 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b943f6-0e60-447f-a16d-8441bf92f4cc None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:57.066975 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346257b-ad4a-420b-91f0-ed0490b039d6 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:57.071256 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd398f-3c7d-4dcf-b9c9-9d0cd81bf371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:57.072003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd398f-3c7d-4dcf-b9c9-9d0cd81bf371 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:57.072360 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd398f-3c7d-4dcf-b9c9-9d0cd81bf371 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:57.072640 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd398f-3c7d-4dcf-b9c9-9d0cd81bf371 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:57.073390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd398f-3c7d-4dcf-b9c9-9d0cd81bf371 None admin] RBAC: Adding query filter params (name=member) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:57.073712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd398f-3c7d-4dcf-b9c9-9d0cd81bf371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:57.075513 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd398f-3c7d-4dcf-b9c9-9d0cd81bf371 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:57.087217 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 71/130] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:24:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:57.087848 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd398f-3c7d-4dcf-b9c9-9d0cd81bf371 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:57.111144 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3d061-dd08-4d70-ab52-8b0003364699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:57.111927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3d061-dd08-4d70-ab52-8b0003364699 None admin] REQUEST_METHOD: `PUT` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:57.112250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3d061-dd08-4d70-ab52-8b0003364699 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:57.112640 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3d061-dd08-4d70-ab52-8b0003364699 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4/users/c335a23dde39460b97b39ea387e956fb/roles/1f86135571074da38ac7d898436a8862` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:57.115142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3d061-dd08-4d70-ab52-8b0003364699 None admin] RBAC: Authorizing `identity:create_grant(project_id=39c3c57ed064477baba507d8cda5eee4, user_id=c335a23dde39460b97b39ea387e956fb, role_id=1f86135571074da38ac7d898436a8862)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:57.116395 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:57.117066 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3d061-dd08-4d70-ab52-8b0003364699 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:57.179261 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 60/131] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:24:56 2022] PUT /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4/users/c335a23dde39460b97b39ea387e956fb/roles/1f86135571074da38ac7d898436a8862 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:24:57.179261 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3d061-dd08-4d70-ab52-8b0003364699 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:57.194871 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:57.232911 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd398f-3c7d-4dcf-b9c9-9d0cd81bf371 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:57.280330 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec835d1-49e1-4bf3-8420-0f20e930206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:57.280981 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec835d1-49e1-4bf3-8420-0f20e930206c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:57.281418 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec835d1-49e1-4bf3-8420-0f20e930206c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:57.281787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec835d1-49e1-4bf3-8420-0f20e930206c None admin] PATH_INFO: `/v3/projects/d3d75ef43ce540138519e2b9c96a0bb3` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:57.283353 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec835d1-49e1-4bf3-8420-0f20e930206c None admin] RBAC: Authorizing `identity:get_project(project_id=d3d75ef43ce540138519e2b9c96a0bb3)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:57.285908 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec835d1-49e1-4bf3-8420-0f20e930206c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:57.293487 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 72/132] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:24:57 2022] GET /identity/v3/projects/d3d75ef43ce540138519e2b9c96a0bb3 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:57.294580 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec835d1-49e1-4bf3-8420-0f20e930206c None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:57.316049 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3d061-dd08-4d70-ab52-8b0003364699 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:57.368418 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47af21-a514-4389-8d00-8bbd6c98e703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:57.369614 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47af21-a514-4389-8d00-8bbd6c98e703 None admin] REQUEST_METHOD: `PUT` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:57.370085 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47af21-a514-4389-8d00-8bbd6c98e703 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:57.370589 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47af21-a514-4389-8d00-8bbd6c98e703 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4/users/b441ea8946b74edd833bbf63322f9350/roles/091802a86e334e129210219b7c69359d` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:57.374802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47af21-a514-4389-8d00-8bbd6c98e703 None admin] RBAC: Authorizing `identity:create_grant(project_id=39c3c57ed064477baba507d8cda5eee4, user_id=b441ea8946b74edd833bbf63322f9350, role_id=091802a86e334e129210219b7c69359d)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:57.377386 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47af21-a514-4389-8d00-8bbd6c98e703 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:57.417283 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:57.431298 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec835d1-49e1-4bf3-8420-0f20e930206c None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:57.471796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b0c74-418f-4ee1-902a-d96e85301ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:57.472626 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b0c74-418f-4ee1-902a-d96e85301ae6 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:57.473045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b0c74-418f-4ee1-902a-d96e85301ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:57.473443 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b0c74-418f-4ee1-902a-d96e85301ae6 None admin] PATH_INFO: `/v3/users/c335a23dde39460b97b39ea387e956fb` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:57.474867 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b0c74-418f-4ee1-902a-d96e85301ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=c335a23dde39460b97b39ea387e956fb)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:57.476622 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b0c74-418f-4ee1-902a-d96e85301ae6 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:57.478554 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 73/133] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:24:57 2022] GET /identity/v3/users/c335a23dde39460b97b39ea387e956fb => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:57.480180 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747646e8-ad4e-468d-b14d-a8abcc653c6d None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:57.480607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747646e8-ad4e-468d-b14d-a8abcc653c6d None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:57.481006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747646e8-ad4e-468d-b14d-a8abcc653c6d None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:57.490201 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 61/134] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:24:57 2022] PUT /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4/users/b441ea8946b74edd833bbf63322f9350/roles/091802a86e334e129210219b7c69359d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:24:57.491208 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47af21-a514-4389-8d00-8bbd6c98e703 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:57.492071 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 74/135] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:57 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:57.496198 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747646e8-ad4e-468d-b14d-a8abcc653c6d None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:57.591979 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:57.637195 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47af21-a514-4389-8d00-8bbd6c98e703 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:57.691826 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9316a3-54b1-489d-95f1-56159a0cead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:57.692572 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9316a3-54b1-489d-95f1-56159a0cead5 None admin] REQUEST_METHOD: `PUT` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:57.692855 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9316a3-54b1-489d-95f1-56159a0cead5 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:57.693134 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9316a3-54b1-489d-95f1-56159a0cead5 None admin] PATH_INFO: `/v3/projects/d3d75ef43ce540138519e2b9c96a0bb3/users/c335a23dde39460b97b39ea387e956fb/roles/4bc1625db2f14e779d8acb4d21d9d3f1` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:57.697689 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9316a3-54b1-489d-95f1-56159a0cead5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3d75ef43ce540138519e2b9c96a0bb3, user_id=c335a23dde39460b97b39ea387e956fb, role_id=4bc1625db2f14e779d8acb4d21d9d3f1)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:57.699323 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9316a3-54b1-489d-95f1-56159a0cead5 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:57.732396 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747646e8-ad4e-468d-b14d-a8abcc653c6d None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:57.782787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762fa63-e314-4687-9ffb-5149be03fe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:57.783488 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762fa63-e314-4687-9ffb-5149be03fe32 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:57.783820 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762fa63-e314-4687-9ffb-5149be03fe32 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:57.784120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762fa63-e314-4687-9ffb-5149be03fe32 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:57.787333 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762fa63-e314-4687-9ffb-5149be03fe32 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:57.788862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762fa63-e314-4687-9ffb-5149be03fe32 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:57.790856 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 75/136] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:24:57 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:57.791929 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f0c32-a382-48e9-b446-d90f4c616474 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:57.792213 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f0c32-a382-48e9-b446-d90f4c616474 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:57.792494 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f0c32-a382-48e9-b446-d90f4c616474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:57.810356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 62/137] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:24:57 2022] PUT /identity/v3/projects/d3d75ef43ce540138519e2b9c96a0bb3/users/c335a23dde39460b97b39ea387e956fb/roles/4bc1625db2f14e779d8acb4d21d9d3f1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:24:57.812110 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9316a3-54b1-489d-95f1-56159a0cead5 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:57.826593 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-5d7f0c32-a382-48e9-b446-d90f4c616474 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:57.835327 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-5d7f0c32-a382-48e9-b446-d90f4c616474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:57.884860 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:58.022311 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 76/138] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:58.024762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947a141-7511-44ee-a3a2-ab713fa7ac79 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:58.025273 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947a141-7511-44ee-a3a2-ab713fa7ac79 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:58.025761 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947a141-7511-44ee-a3a2-ab713fa7ac79 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:58.028290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 77/139] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:24:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:24:58.036999 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0039a-ef2c-43dc-9599-b349da978d66 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:58.037481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0039a-ef2c-43dc-9599-b349da978d66 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:58.038004 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0039a-ef2c-43dc-9599-b349da978d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:58.081389 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-47f0039a-ef2c-43dc-9599-b349da978d66 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:58.082673 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-47f0039a-ef2c-43dc-9599-b349da978d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:58.094990 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9316a3-54b1-489d-95f1-56159a0cead5 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:58.143456 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:58.161067 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af875df9-dde3-4eae-95ed-4b6b44761cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:58.162330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875df9-dde3-4eae-95ed-4b6b44761cd8 None admin] REQUEST_METHOD: `PUT` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:58.162908 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875df9-dde3-4eae-95ed-4b6b44761cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:58.163446 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875df9-dde3-4eae-95ed-4b6b44761cd8 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4/users/c335a23dde39460b97b39ea387e956fb/roles/4bc1625db2f14e779d8acb4d21d9d3f1` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:58.167586 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af875df9-dde3-4eae-95ed-4b6b44761cd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=39c3c57ed064477baba507d8cda5eee4, user_id=c335a23dde39460b97b39ea387e956fb, role_id=4bc1625db2f14e779d8acb4d21d9d3f1)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:58.170703 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af875df9-dde3-4eae-95ed-4b6b44761cd8 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:58.172766 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 78/140] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:24:58.260809 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 63/141] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:24:57 2022] PUT /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4/users/c335a23dde39460b97b39ea387e956fb/roles/4bc1625db2f14e779d8acb4d21d9d3f1 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:24:58.479315 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0039a-ef2c-43dc-9599-b349da978d66 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:58.600791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:58.619968 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0039a-ef2c-43dc-9599-b349da978d66 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:58.669839 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8be447-0a1e-425f-a35e-ccd138f3381f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:58.670524 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be447-0a1e-425f-a35e-ccd138f3381f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:58.670863 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be447-0a1e-425f-a35e-ccd138f3381f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:58.671144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be447-0a1e-425f-a35e-ccd138f3381f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:58.672375 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8be447-0a1e-425f-a35e-ccd138f3381f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:58.674016 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8be447-0a1e-425f-a35e-ccd138f3381f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:58.676014 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 79/142] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:24:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:58.682735 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af875df9-dde3-4eae-95ed-4b6b44761cd8 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:58.822292 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8be447-0a1e-425f-a35e-ccd138f3381f None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:58.877476 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af875df9-dde3-4eae-95ed-4b6b44761cd8 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:58.957939 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a7ff8-6c45-4b60-b555-b4c6a1f6bd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:58.958581 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a7ff8-6c45-4b60-b555-b4c6a1f6bd52 None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:58.958867 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a7ff8-6c45-4b60-b555-b4c6a1f6bd52 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:58.959146 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a7ff8-6c45-4b60-b555-b4c6a1f6bd52 None admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:58.959850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a7ff8-6c45-4b60-b555-b4c6a1f6bd52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:58.961336 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a7ff8-6c45-4b60-b555-b4c6a1f6bd52 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:59.019520 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8be447-0a1e-425f-a35e-ccd138f3381f None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:59.076364 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 64/143] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Aug 23 16:24:58 2022] POST /identity/v3/users => generated 283 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:24:59.077238 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3654b-5880-4b25-ba9d-9d473cedcffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:59.078305 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3654b-5880-4b25-ba9d-9d473cedcffa None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:59.078640 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3654b-5880-4b25-ba9d-9d473cedcffa None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:59.078921 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3654b-5880-4b25-ba9d-9d473cedcffa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:59.097719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3654b-5880-4b25-ba9d-9d473cedcffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-78c3654b-5880-4b25-ba9d-9d473cedcffa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:24:59.102752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:24:59.103712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:24:59.104816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:24:59.104816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:24:59.104816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:24:59.104816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:24:59.104816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:24:59.104816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:24:59.104816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:24:59.104816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:24:59.104816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:24:59.104816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:24:59.104816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:24:59.104816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:24:59.109142 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 80/144] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:24:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:24:59.115838 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a7ff8-6c45-4b60-b555-b4c6a1f6bd52 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:59.218269 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:59.302400 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a7ff8-6c45-4b60-b555-b4c6a1f6bd52 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:59.366895 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cb18a-a8a5-41cf-a66e-ce0ea18c4ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:59.367771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cb18a-a8a5-41cf-a66e-ce0ea18c4ef4 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:59.368228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cb18a-a8a5-41cf-a66e-ce0ea18c4ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:59.368685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cb18a-a8a5-41cf-a66e-ce0ea18c4ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:59.369559 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cb18a-a8a5-41cf-a66e-ce0ea18c4ef4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:59.369879 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cb18a-a8a5-41cf-a66e-ce0ea18c4ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:59.372079 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cb18a-a8a5-41cf-a66e-ce0ea18c4ef4 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:59.390204 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 65/145] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:24:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:59.396735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3654b-5880-4b25-ba9d-9d473cedcffa None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:59.416817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:59.509081 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3654b-5880-4b25-ba9d-9d473cedcffa None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:59.545544 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335f9b4-7464-4812-a55b-185236adf33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:59.546177 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335f9b4-7464-4812-a55b-185236adf33b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:59.546458 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335f9b4-7464-4812-a55b-185236adf33b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:59.546732 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335f9b4-7464-4812-a55b-185236adf33b None admin] PATH_INFO: `/v3/users/843d300923b8449aa6452cbe47210f37` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:59.547931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335f9b4-7464-4812-a55b-185236adf33b None admin] RBAC: Authorizing `identity:get_user(user_id=843d300923b8449aa6452cbe47210f37)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:59.549392 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335f9b4-7464-4812-a55b-185236adf33b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:59.551335 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 81/146] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:24:59 2022] GET /identity/v3/users/843d300923b8449aa6452cbe47210f37 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:59.560635 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cb18a-a8a5-41cf-a66e-ce0ea18c4ef4 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:59.692663 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cb18a-a8a5-41cf-a66e-ce0ea18c4ef4 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:59.703334 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:59.740370 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d65ee1-ae96-4d82-b87f-aae28e652e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:59.743970 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d65ee1-ae96-4d82-b87f-aae28e652e3e None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:59.744266 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d65ee1-ae96-4d82-b87f-aae28e652e3e None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:59.744554 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d65ee1-ae96-4d82-b87f-aae28e652e3e None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:59.745762 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d65ee1-ae96-4d82-b87f-aae28e652e3e None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:59.747270 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d65ee1-ae96-4d82-b87f-aae28e652e3e None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:59.749682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 66/147] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:24:59 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:24:59.756556 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335f9b4-7464-4812-a55b-185236adf33b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:59.863866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:59.890474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335f9b4-7464-4812-a55b-185236adf33b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:59.934970 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d466303-2cac-4b89-bcb5-c48c62986fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:59.935743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d466303-2cac-4b89-bcb5-c48c62986fa5 None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:59.936025 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d466303-2cac-4b89-bcb5-c48c62986fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:59.936300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d466303-2cac-4b89-bcb5-c48c62986fa5 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4/users/843d300923b8449aa6452cbe47210f37/roles/225f2a2bd302418485ac34ecb871c3e4` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:59.938882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d466303-2cac-4b89-bcb5-c48c62986fa5 None admin] RBAC: Authorizing `identity:create_grant(project_id=39c3c57ed064477baba507d8cda5eee4, user_id=843d300923b8449aa6452cbe47210f37, role_id=225f2a2bd302418485ac34ecb871c3e4)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:59.940455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d466303-2cac-4b89-bcb5-c48c62986fa5 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:00.038059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 82/148] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:24:59 2022] PUT /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4/users/843d300923b8449aa6452cbe47210f37/roles/225f2a2bd302418485ac34ecb871c3e4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:25:00.181933 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca500-8d91-4d60-80f1-7476983936a3 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:00.182452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca500-8d91-4d60-80f1-7476983936a3 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:00.182522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca500-8d91-4d60-80f1-7476983936a3 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:00.184214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 67/149] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:00.189909 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee828e-45e1-418c-a518-f6a113157a71 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:00.190190 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee828e-45e1-418c-a518-f6a113157a71 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:00.190540 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee828e-45e1-418c-a518-f6a113157a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:00.214091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-26ee828e-45e1-418c-a518-f6a113157a71 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:00.215332 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-26ee828e-45e1-418c-a518-f6a113157a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:00.301928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 83/150] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:00.648900 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d7421-7bb4-449f-a9ac-2a568459a95b None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:00.649238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d7421-7bb4-449f-a9ac-2a568459a95b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:00.649436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d7421-7bb4-449f-a9ac-2a568459a95b None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:00.651072 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 68/151] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:00.658157 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591766a-d34b-441d-9fd1-6007e70bf4af None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:00.658449 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591766a-d34b-441d-9fd1-6007e70bf4af None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:00.658718 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591766a-d34b-441d-9fd1-6007e70bf4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:00.677853 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-8591766a-d34b-441d-9fd1-6007e70bf4af None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:00.679039 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-8591766a-d34b-441d-9fd1-6007e70bf4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:00.776153 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 84/152] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:00.810166 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d7421-7bb4-449f-a9ac-2a568459a95b None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:00.939459 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d7421-7bb4-449f-a9ac-2a568459a95b None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:00.987170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1942ad-ab15-4fba-8ab2-99d300509e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:00.987851 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1942ad-ab15-4fba-8ab2-99d300509e53 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:00.988137 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1942ad-ab15-4fba-8ab2-99d300509e53 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:00.988415 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1942ad-ab15-4fba-8ab2-99d300509e53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:01.001016 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1942ad-ab15-4fba-8ab2-99d300509e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-8f1942ad-ab15-4fba-8ab2-99d300509e53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:01.006407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:01.007277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:01.008075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:01.008075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:01.008075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:01.008075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:01.008075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:01.008075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:01.008075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:01.008075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:01.008075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:01.008075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:01.008075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:01.008075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:01.008075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 69/153] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:25:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:01.015795 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591766a-d34b-441d-9fd1-6007e70bf4af None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:01.018542 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:01.136685 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591766a-d34b-441d-9fd1-6007e70bf4af None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:01.175765 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92179b-9a5c-4e33-84bf-bf8c174a11c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:01.176387 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92179b-9a5c-4e33-84bf-bf8c174a11c2 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:01.176665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92179b-9a5c-4e33-84bf-bf8c174a11c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:01.176938 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92179b-9a5c-4e33-84bf-bf8c174a11c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:01.177607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92179b-9a5c-4e33-84bf-bf8c174a11c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:01.177910 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92179b-9a5c-4e33-84bf-bf8c174a11c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:01.179325 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92179b-9a5c-4e33-84bf-bf8c174a11c2 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:01.189921 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 85/154] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:01.195912 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1942ad-ab15-4fba-8ab2-99d300509e53 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:01.236917 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:01.336219 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1942ad-ab15-4fba-8ab2-99d300509e53 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:01.377986 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeae50c-85a9-4ab2-ad89-f55dbb76dad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:01.378630 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeae50c-85a9-4ab2-ad89-f55dbb76dad4 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:01.378916 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeae50c-85a9-4ab2-ad89-f55dbb76dad4 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:01.379189 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeae50c-85a9-4ab2-ad89-f55dbb76dad4 None admin] PATH_INFO: `/v3/users/c335a23dde39460b97b39ea387e956fb` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:01.380453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeae50c-85a9-4ab2-ad89-f55dbb76dad4 None admin] RBAC: Authorizing `identity:get_user(user_id=c335a23dde39460b97b39ea387e956fb)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:01.382023 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeae50c-85a9-4ab2-ad89-f55dbb76dad4 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:01.383884 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 70/155] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:01 2022] GET /identity/v3/users/c335a23dde39460b97b39ea387e956fb => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:01.390221 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92179b-9a5c-4e33-84bf-bf8c174a11c2 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:01.458693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:01.501989 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92179b-9a5c-4e33-84bf-bf8c174a11c2 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:01.543902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0aaea-6d03-444c-850d-f86c912962c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:01.544526 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0aaea-6d03-444c-850d-f86c912962c3 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:01.544796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0aaea-6d03-444c-850d-f86c912962c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:01.545100 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0aaea-6d03-444c-850d-f86c912962c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:01.635109 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0aaea-6d03-444c-850d-f86c912962c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:01.636652 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0aaea-6d03-444c-850d-f86c912962c3 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:01.718660 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:01.745573 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeae50c-85a9-4ab2-ad89-f55dbb76dad4 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:01.792022 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 86/156] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:01.798549 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0aaea-6d03-444c-850d-f86c912962c3 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:01.987007 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0aaea-6d03-444c-850d-f86c912962c3 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:02.009935 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeae50c-85a9-4ab2-ad89-f55dbb76dad4 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:02.012186 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:02.037948 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725457c-9579-4abb-a8c0-fd1d9cad8b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:02.039091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725457c-9579-4abb-a8c0-fd1d9cad8b55 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:02.039656 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725457c-9579-4abb-a8c0-fd1d9cad8b55 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:02.040617 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725457c-9579-4abb-a8c0-fd1d9cad8b55 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:02.042149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725457c-9579-4abb-a8c0-fd1d9cad8b55 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:02.043931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725457c-9579-4abb-a8c0-fd1d9cad8b55 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:02.048784 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 87/157] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:01 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:02.057596 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725457c-9579-4abb-a8c0-fd1d9cad8b55 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:02.104832 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:02.120035 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0d0ca-5663-4860-b405-7094354004e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:02.120946 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0d0ca-5663-4860-b405-7094354004e4 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:02.121372 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0d0ca-5663-4860-b405-7094354004e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:02.121817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0d0ca-5663-4860-b405-7094354004e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:02.155932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0d0ca-5663-4860-b405-7094354004e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-faf0d0ca-5663-4860-b405-7094354004e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:02.161481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:02.162373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:02.163142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:02.163142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:02.163142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:02.163142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:02.163142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:02.163142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:02.163142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:02.163142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:02.163142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:02.163142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:02.163142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:02.163142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:02.165852 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 71/158] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:25:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:02.172276 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0d0ca-5663-4860-b405-7094354004e4 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:02.285771 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725457c-9579-4abb-a8c0-fd1d9cad8b55 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:02.353122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e32e3-3def-4a8f-b11c-510bc43b6b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:02.354076 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e32e3-3def-4a8f-b11c-510bc43b6b76 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:02.354532 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e32e3-3def-4a8f-b11c-510bc43b6b76 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:02.355004 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e32e3-3def-4a8f-b11c-510bc43b6b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:02.356085 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e32e3-3def-4a8f-b11c-510bc43b6b76 None admin] RBAC: Adding query filter params (role.id=1f86135571074da38ac7d898436a8862, scope.project.id=39c3c57ed064477baba507d8cda5eee4, user.id=c335a23dde39460b97b39ea387e956fb) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:02.356691 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e32e3-3def-4a8f-b11c-510bc43b6b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:02.358897 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e32e3-3def-4a8f-b11c-510bc43b6b76 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:02.365842 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 88/159] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:02 2022] GET /identity/v3/role_assignments?user.id=c335a23dde39460b97b39ea387e956fb&scope.project.id=39c3c57ed064477baba507d8cda5eee4&role.id=1f86135571074da38ac7d898436a8862 => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:02.391641 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0d0ca-5663-4860-b405-7094354004e4 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:02.447150 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b040f86-6ada-44e2-bc83-d470286a2212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:02.447887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b040f86-6ada-44e2-bc83-d470286a2212 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:02.448173 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b040f86-6ada-44e2-bc83-d470286a2212 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:02.448448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b040f86-6ada-44e2-bc83-d470286a2212 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:02.449146 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b040f86-6ada-44e2-bc83-d470286a2212 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:02.449453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b040f86-6ada-44e2-bc83-d470286a2212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:02.450888 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b040f86-6ada-44e2-bc83-d470286a2212 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:02.461059 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 72/160] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:02.466968 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e32e3-3def-4a8f-b11c-510bc43b6b76 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:02.497139 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772216e3-0e50-430d-bf6c-1fb30e0f6e01 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:02.497422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772216e3-0e50-430d-bf6c-1fb30e0f6e01 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:02.497919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772216e3-0e50-430d-bf6c-1fb30e0f6e01 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:02.499633 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 73/161] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:25:02.508274 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8412260-ad0a-452e-8614-08b8073e720e None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:02.508893 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8412260-ad0a-452e-8614-08b8073e720e None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:02.509421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8412260-ad0a-452e-8614-08b8073e720e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:02.538456 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-e8412260-ad0a-452e-8614-08b8073e720e None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:02.540088 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-e8412260-ad0a-452e-8614-08b8073e720e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:02.568084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:02.615167 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:02.625995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e32e3-3def-4a8f-b11c-510bc43b6b76 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:02.653650 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 74/162] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:02.671376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adece5a-61c3-473b-9c8a-bfe5ad843c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:02.672374 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adece5a-61c3-473b-9c8a-bfe5ad843c0f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:02.672823 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adece5a-61c3-473b-9c8a-bfe5ad843c0f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:02.673265 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adece5a-61c3-473b-9c8a-bfe5ad843c0f None admin] PATH_INFO: `/v3/users/b441ea8946b74edd833bbf63322f9350` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:02.674665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adece5a-61c3-473b-9c8a-bfe5ad843c0f None admin] RBAC: Authorizing `identity:get_user(user_id=b441ea8946b74edd833bbf63322f9350)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:02.676363 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adece5a-61c3-473b-9c8a-bfe5ad843c0f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:02.678168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 89/163] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:02 2022] GET /identity/v3/users/b441ea8946b74edd833bbf63322f9350 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:02.683942 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8412260-ad0a-452e-8614-08b8073e720e None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:02.799415 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0ebd-3344-470e-829a-5321bdd09849 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:02.799601 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0ebd-3344-470e-829a-5321bdd09849 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:02.799871 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0ebd-3344-470e-829a-5321bdd09849 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:02.801205 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 90/164] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:25:02.820266 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c9c3-417c-43dd-915b-3f59085947ca None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:02.820542 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c9c3-417c-43dd-915b-3f59085947ca None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:02.820815 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c9c3-417c-43dd-915b-3f59085947ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:02.850370 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-c328c9c3-417c-43dd-915b-3f59085947ca None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:02.850944 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-c328c9c3-417c-43dd-915b-3f59085947ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:02.858702 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8412260-ad0a-452e-8614-08b8073e720e None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:02.941365 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46a99d-5689-4c9a-901c-33446b10d126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:02.941997 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46a99d-5689-4c9a-901c-33446b10d126 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:02.942327 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46a99d-5689-4c9a-901c-33446b10d126 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:02.942605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46a99d-5689-4c9a-901c-33446b10d126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:02.961123 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 91/165] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:02.982954 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:03.042667 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46a99d-5689-4c9a-901c-33446b10d126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:03.044198 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46a99d-5689-4c9a-901c-33446b10d126 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:03.171838 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 75/166] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:03.177423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328c9c3-417c-43dd-915b-3f59085947ca None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:03.265115 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46a99d-5689-4c9a-901c-33446b10d126 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:03.290732 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:03.297817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328c9c3-417c-43dd-915b-3f59085947ca None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:03.354920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b96d9-1be1-47cc-9941-47977b08e10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:03.355603 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b96d9-1be1-47cc-9941-47977b08e10a None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:03.355882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b96d9-1be1-47cc-9941-47977b08e10a None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:03.356218 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b96d9-1be1-47cc-9941-47977b08e10a None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:03.359947 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b96d9-1be1-47cc-9941-47977b08e10a None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:03.362215 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b96d9-1be1-47cc-9941-47977b08e10a None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:03.364138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 92/167] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:03 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:03.371036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b96d9-1be1-47cc-9941-47977b08e10a None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:03.385401 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:03.487457 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46a99d-5689-4c9a-901c-33446b10d126 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:03.591758 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b96d9-1be1-47cc-9941-47977b08e10a None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:03.604048 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf7afa-d395-4027-893d-750a593cc775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:03.604721 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7afa-d395-4027-893d-750a593cc775 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:03.604998 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7afa-d395-4027-893d-750a593cc775 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:03.605460 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7afa-d395-4027-893d-750a593cc775 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:03.632275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf7afa-d395-4027-893d-750a593cc775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-2ddf7afa-d395-4027-893d-750a593cc775 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:03.640549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:03.641864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:03.642870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:03.642870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:03.642870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:03.642870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:03.642870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:03.642870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:03.642870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:03.642870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:03.642870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:03.642870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:03.642870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:03.642870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:03.644815 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 76/168] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:25:03.650904 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf7afa-d395-4027-893d-750a593cc775 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:03.668635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1330e-d37c-4b13-bb6e-96ed10bab73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:03.669370 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1330e-d37c-4b13-bb6e-96ed10bab73c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:03.669653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1330e-d37c-4b13-bb6e-96ed10bab73c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:03.669923 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1330e-d37c-4b13-bb6e-96ed10bab73c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:03.670711 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1330e-d37c-4b13-bb6e-96ed10bab73c None admin] RBAC: Adding query filter params (role.id=091802a86e334e129210219b7c69359d, scope.project.id=39c3c57ed064477baba507d8cda5eee4, user.id=b441ea8946b74edd833bbf63322f9350) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:03.671021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1330e-d37c-4b13-bb6e-96ed10bab73c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:03.673144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1330e-d37c-4b13-bb6e-96ed10bab73c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:03.684994 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 93/169] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:03 2022] GET /identity/v3/role_assignments?user.id=b441ea8946b74edd833bbf63322f9350&scope.project.id=39c3c57ed064477baba507d8cda5eee4&role.id=091802a86e334e129210219b7c69359d => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:03.858365 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf7afa-d395-4027-893d-750a593cc775 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:03.880503 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:03.896613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7acc4-0845-4349-962e-770711893c08 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:03.897214 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7acc4-0845-4349-962e-770711893c08 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:03.897688 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7acc4-0845-4349-962e-770711893c08 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:03.899900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 94/170] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:03.905805 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13041-4341-46da-bff1-718a8be8eec1 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:03.905968 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979a5e4-9c7d-4cbb-95d5-3aa5fb3d8b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:03.906474 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979a5e4-9c7d-4cbb-95d5-3aa5fb3d8b50 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:03.906736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13041-4341-46da-bff1-718a8be8eec1 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:03.906836 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979a5e4-9c7d-4cbb-95d5-3aa5fb3d8b50 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:03.907013 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979a5e4-9c7d-4cbb-95d5-3aa5fb3d8b50 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:03.907525 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13041-4341-46da-bff1-718a8be8eec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:03.907782 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979a5e4-9c7d-4cbb-95d5-3aa5fb3d8b50 None admin] RBAC: Adding query filter params (name=member) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:03.908097 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979a5e4-9c7d-4cbb-95d5-3aa5fb3d8b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:03.909485 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979a5e4-9c7d-4cbb-95d5-3aa5fb3d8b50 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:03.924353 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 77/171] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:03.925289 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979a5e4-9c7d-4cbb-95d5-3aa5fb3d8b50 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:03.944407 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-70c13041-4341-46da-bff1-718a8be8eec1 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:03.946078 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-70c13041-4341-46da-bff1-718a8be8eec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:03.988538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:04.103205 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 95/172] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:04.104081 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13041-4341-46da-bff1-718a8be8eec1 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:04.129893 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979a5e4-9c7d-4cbb-95d5-3aa5fb3d8b50 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:04.193348 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6ddc3-8fa0-4748-bbdc-565b58a0a16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:04.194235 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6ddc3-8fa0-4748-bbdc-565b58a0a16f None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:04.194657 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6ddc3-8fa0-4748-bbdc-565b58a0a16f None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:04.195070 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6ddc3-8fa0-4748-bbdc-565b58a0a16f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:04.215382 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6ddc3-8fa0-4748-bbdc-565b58a0a16f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-68c6ddc3-8fa0-4748-bbdc-565b58a0a16f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:04.221430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:04.222346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:04.223131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:04.223131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:04.223131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:04.223131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:04.223131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:04.223131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:04.223131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:04.223131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:04.223131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:04.223131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:04.223131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:04.223131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:04.225545 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 78/173] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:04.231861 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6ddc3-8fa0-4748-bbdc-565b58a0a16f None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:04.279478 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:04.312726 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13041-4341-46da-bff1-718a8be8eec1 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:04.362349 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dc7d3-7ac1-414c-82a4-c8ce5d0675ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:04.363239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dc7d3-7ac1-414c-82a4-c8ce5d0675ec None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:04.367824 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dc7d3-7ac1-414c-82a4-c8ce5d0675ec None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:04.368278 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dc7d3-7ac1-414c-82a4-c8ce5d0675ec None admin] PATH_INFO: `/v3/users/c335a23dde39460b97b39ea387e956fb` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:04.369762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dc7d3-7ac1-414c-82a4-c8ce5d0675ec None admin] RBAC: Authorizing `identity:get_user(user_id=c335a23dde39460b97b39ea387e956fb)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:04.371431 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dc7d3-7ac1-414c-82a4-c8ce5d0675ec None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:04.373705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 96/174] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:04 2022] GET /identity/v3/users/c335a23dde39460b97b39ea387e956fb => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:04.378855 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dc7d3-7ac1-414c-82a4-c8ce5d0675ec None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:04.390258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6ddc3-8fa0-4748-bbdc-565b58a0a16f None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:04.414722 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:04.449023 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f6f5-c8db-4de1-a699-57bb3d704ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:04.449666 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f6f5-c8db-4de1-a699-57bb3d704ac4 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:04.449952 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f6f5-c8db-4de1-a699-57bb3d704ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:04.450227 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f6f5-c8db-4de1-a699-57bb3d704ac4 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:04.450920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379f6f5-c8db-4de1-a699-57bb3d704ac4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:04.451211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379f6f5-c8db-4de1-a699-57bb3d704ac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:04.453374 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379f6f5-c8db-4de1-a699-57bb3d704ac4 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:04.473779 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 79/175] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:04.484530 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f6f5-c8db-4de1-a699-57bb3d704ac4 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:04.508958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dc7d3-7ac1-414c-82a4-c8ce5d0675ec None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:04.546279 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd7e68-31f3-41d4-9709-aff0b94a9532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:04.547263 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd7e68-31f3-41d4-9709-aff0b94a9532 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:04.547759 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd7e68-31f3-41d4-9709-aff0b94a9532 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:04.548221 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd7e68-31f3-41d4-9709-aff0b94a9532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:04.624813 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd7e68-31f3-41d4-9709-aff0b94a9532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:04.626595 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd7e68-31f3-41d4-9709-aff0b94a9532 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:04.642955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f6f5-c8db-4de1-a699-57bb3d704ac4 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:04.655271 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:04.659634 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:04.704057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7878c7-0b32-4fd0-b0c0-9f44f0bc6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:04.704703 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7878c7-0b32-4fd0-b0c0-9f44f0bc6fcc None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:04.704987 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7878c7-0b32-4fd0-b0c0-9f44f0bc6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:04.705264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7878c7-0b32-4fd0-b0c0-9f44f0bc6fcc None admin] PATH_INFO: `/v3/users/c335a23dde39460b97b39ea387e956fb` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:04.707337 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7878c7-0b32-4fd0-b0c0-9f44f0bc6fcc None admin] RBAC: Authorizing `identity:get_user(user_id=c335a23dde39460b97b39ea387e956fb)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:04.708803 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7878c7-0b32-4fd0-b0c0-9f44f0bc6fcc None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:04.714515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 80/176] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:04 2022] GET /identity/v3/users/c335a23dde39460b97b39ea387e956fb => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:04.714515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d05fd-c470-4751-bc6e-197f8da6f39d None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:04.714515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d05fd-c470-4751-bc6e-197f8da6f39d None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:04.714515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d05fd-c470-4751-bc6e-197f8da6f39d None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:04.714515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 81/177] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:04.714515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d05fd-c470-4751-bc6e-197f8da6f39d None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:04.762023 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 97/178] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:25:04.764606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd7e68-31f3-41d4-9709-aff0b94a9532 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:04.854978 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d05fd-c470-4751-bc6e-197f8da6f39d None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:04.895580 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be52ee6-3eed-4384-afcd-95f777ff7b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:04.896409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd7e68-31f3-41d4-9709-aff0b94a9532 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:04.896786 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be52ee6-3eed-4384-afcd-95f777ff7b4a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:04.897251 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be52ee6-3eed-4384-afcd-95f777ff7b4a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:04.897817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be52ee6-3eed-4384-afcd-95f777ff7b4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:04.910586 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be52ee6-3eed-4384-afcd-95f777ff7b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-2be52ee6-3eed-4384-afcd-95f777ff7b4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:04.916467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:04.917345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:04.918153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:04.918153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:04.918153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:04.918153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:04.918153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:04.918153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:04.918153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:04.918153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:04.918153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:04.918153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:04.918153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:04.918153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:04.920659 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 82/179] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:25:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:04.922113 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c399d-1a52-4e9c-8fcf-e052a79b07c8 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:04.922591 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c399d-1a52-4e9c-8fcf-e052a79b07c8 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:04.923069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c399d-1a52-4e9c-8fcf-e052a79b07c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:04.928066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:04.941727 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02763ded-684f-4fc9-b801-67b4127db4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:04.942338 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02763ded-684f-4fc9-b801-67b4127db4ee None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:04.942619 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02763ded-684f-4fc9-b801-67b4127db4ee None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:04.942892 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02763ded-684f-4fc9-b801-67b4127db4ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:04.946001 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-aa4c399d-1a52-4e9c-8fcf-e052a79b07c8 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:04.947564 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-aa4c399d-1a52-4e9c-8fcf-e052a79b07c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:04.980065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:05.033262 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02763ded-684f-4fc9-b801-67b4127db4ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:05.034727 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02763ded-684f-4fc9-b801-67b4127db4ee None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:05.050797 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 83/180] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:05.052806 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c399d-1a52-4e9c-8fcf-e052a79b07c8 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:05.145673 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 98/181] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:05.146584 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02763ded-684f-4fc9-b801-67b4127db4ee None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:05.188228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:05.190595 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c399d-1a52-4e9c-8fcf-e052a79b07c8 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:05.229267 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b019c05-560a-411d-8e0f-11c5d1229c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:05.229950 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019c05-560a-411d-8e0f-11c5d1229c30 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:05.230500 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019c05-560a-411d-8e0f-11c5d1229c30 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:05.230966 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019c05-560a-411d-8e0f-11c5d1229c30 None admin] PATH_INFO: `/v3/projects/d3d75ef43ce540138519e2b9c96a0bb3` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:05.232512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b019c05-560a-411d-8e0f-11c5d1229c30 None admin] RBAC: Authorizing `identity:get_project(project_id=d3d75ef43ce540138519e2b9c96a0bb3)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:05.234386 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b019c05-560a-411d-8e0f-11c5d1229c30 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:05.236401 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 84/182] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:05 2022] GET /identity/v3/projects/d3d75ef43ce540138519e2b9c96a0bb3 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:05.237408 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b019c05-560a-411d-8e0f-11c5d1229c30 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:05.266679 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:05.294267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02763ded-684f-4fc9-b801-67b4127db4ee None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:05.339641 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028f857-1cbd-4726-a54d-040f1b803e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:05.340283 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028f857-1cbd-4726-a54d-040f1b803e34 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:05.340520 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028f857-1cbd-4726-a54d-040f1b803e34 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:05.340791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028f857-1cbd-4726-a54d-040f1b803e34 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:05.341459 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028f857-1cbd-4726-a54d-040f1b803e34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:05.341762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028f857-1cbd-4726-a54d-040f1b803e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:05.343178 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028f857-1cbd-4726-a54d-040f1b803e34 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:05.351654 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 99/183] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:05.352486 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028f857-1cbd-4726-a54d-040f1b803e34 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:05.353783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b019c05-560a-411d-8e0f-11c5d1229c30 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:05.396433 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f67fb-eb66-4b5c-b0ba-e8a3402989c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:05.397037 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f67fb-eb66-4b5c-b0ba-e8a3402989c9 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:05.397306 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f67fb-eb66-4b5c-b0ba-e8a3402989c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:05.397569 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f67fb-eb66-4b5c-b0ba-e8a3402989c9 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:05.398710 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f67fb-eb66-4b5c-b0ba-e8a3402989c9 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:05.400544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f67fb-eb66-4b5c-b0ba-e8a3402989c9 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:05.402186 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 85/184] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:05 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:05.408361 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853722a-56d2-4f7e-99fd-b7c21effca74 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:05.408710 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853722a-56d2-4f7e-99fd-b7c21effca74 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:05.408903 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853722a-56d2-4f7e-99fd-b7c21effca74 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:05.410375 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 86/185] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:05.411395 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e86bd1-f64c-435e-96a2-8431b6e7c275 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:05.411575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e86bd1-f64c-435e-96a2-8431b6e7c275 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:05.411835 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e86bd1-f64c-435e-96a2-8431b6e7c275 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:05.413255 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 87/186] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:05.413757 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e86bd1-f64c-435e-96a2-8431b6e7c275 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:05.460154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:05.476420 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028f857-1cbd-4726-a54d-040f1b803e34 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:05.513552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c42bfd-0b65-42b4-bd2e-47aff8e38edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:05.514194 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c42bfd-0b65-42b4-bd2e-47aff8e38edf None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:05.514472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c42bfd-0b65-42b4-bd2e-47aff8e38edf None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:05.514743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c42bfd-0b65-42b4-bd2e-47aff8e38edf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:05.515508 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c42bfd-0b65-42b4-bd2e-47aff8e38edf None admin] RBAC: Adding query filter params (role.id=4bc1625db2f14e779d8acb4d21d9d3f1, scope.project.id=d3d75ef43ce540138519e2b9c96a0bb3, user.id=c335a23dde39460b97b39ea387e956fb) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:05.515822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c42bfd-0b65-42b4-bd2e-47aff8e38edf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:05.516003 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:05.517319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c42bfd-0b65-42b4-bd2e-47aff8e38edf None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:05.523164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 100/187] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:05 2022] GET /identity/v3/role_assignments?user.id=c335a23dde39460b97b39ea387e956fb&scope.project.id=d3d75ef43ce540138519e2b9c96a0bb3&role.id=4bc1625db2f14e779d8acb4d21d9d3f1 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:05.523164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c42bfd-0b65-42b4-bd2e-47aff8e38edf None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:05.531843 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e86bd1-f64c-435e-96a2-8431b6e7c275 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:05.566161 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d48f4-16e4-440c-9778-73fb847976cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:05.566814 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d48f4-16e4-440c-9778-73fb847976cf None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:05.567091 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d48f4-16e4-440c-9778-73fb847976cf None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:05.567398 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d48f4-16e4-440c-9778-73fb847976cf None admin] PATH_INFO: `/v3/users/c758fcbb9efa4fe1a05bf329f726ca3c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:05.583176 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d48f4-16e4-440c-9778-73fb847976cf None admin] RBAC: Authorizing `identity:get_user(user_id=c758fcbb9efa4fe1a05bf329f726ca3c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:05.584711 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d48f4-16e4-440c-9778-73fb847976cf None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:05.586486 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 88/188] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:05 2022] GET /identity/v3/users/c758fcbb9efa4fe1a05bf329f726ca3c => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:05.587797 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f918c63-4ac9-4259-8e3d-0a5f9f217fe2 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:05.588081 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f918c63-4ac9-4259-8e3d-0a5f9f217fe2 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:05.588354 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f918c63-4ac9-4259-8e3d-0a5f9f217fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:05.609307 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-3f918c63-4ac9-4259-8e3d-0a5f9f217fe2 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:05.610593 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-3f918c63-4ac9-4259-8e3d-0a5f9f217fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:05.658266 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c42bfd-0b65-42b4-bd2e-47aff8e38edf None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:05.699892 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee7044-79ac-4805-92e4-5454cb0ec2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:05.700889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee7044-79ac-4805-92e4-5454cb0ec2ad None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:05.701164 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 89/189] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:05.702025 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee7044-79ac-4805-92e4-5454cb0ec2ad None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:05.702468 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a905f-a3d8-49ba-98e0-b3d0c9d6c3ea None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:05.702738 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee7044-79ac-4805-92e4-5454cb0ec2ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:05.702840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a905f-a3d8-49ba-98e0-b3d0c9d6c3ea None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:05.703079 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a905f-a3d8-49ba-98e0-b3d0c9d6c3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:05.704084 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee7044-79ac-4805-92e4-5454cb0ec2ad None admin] RBAC: Adding query filter params (role.id=4bc1625db2f14e779d8acb4d21d9d3f1, scope.project.id=39c3c57ed064477baba507d8cda5eee4, user.id=c335a23dde39460b97b39ea387e956fb) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:05.704610 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee7044-79ac-4805-92e4-5454cb0ec2ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:05.706323 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee7044-79ac-4805-92e4-5454cb0ec2ad None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:05.713483 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 101/190] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:05 2022] GET /identity/v3/role_assignments?user.id=c335a23dde39460b97b39ea387e956fb&scope.project.id=39c3c57ed064477baba507d8cda5eee4&role.id=4bc1625db2f14e779d8acb4d21d9d3f1 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:05.720537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee7044-79ac-4805-92e4-5454cb0ec2ad None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:05.730345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-085a905f-a3d8-49ba-98e0-b3d0c9d6c3ea None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:05.731940 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-085a905f-a3d8-49ba-98e0-b3d0c9d6c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:05.746639 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:05.841372 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 90/191] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:05.843270 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a905f-a3d8-49ba-98e0-b3d0c9d6c3ea None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:05.878775 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:05.909091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee7044-79ac-4805-92e4-5454cb0ec2ad None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:05.961899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c1ed9-31a0-442e-8080-63d7e1fe4c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:05.962695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c1ed9-31a0-442e-8080-63d7e1fe4c12 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:05.962991 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c1ed9-31a0-442e-8080-63d7e1fe4c12 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:05.963301 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c1ed9-31a0-442e-8080-63d7e1fe4c12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:05.977012 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c1ed9-31a0-442e-8080-63d7e1fe4c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-d31c1ed9-31a0-442e-8080-63d7e1fe4c12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:05.983130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:05.984267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:05.985045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:05.985045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:05.985045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:05.985045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:05.985045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:05.985045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:05.985045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:05.985045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:05.985045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:05.985045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:05.985045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:05.985045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:05.988096 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 102/192] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:05.995011 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c1ed9-31a0-442e-8080-63d7e1fe4c12 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:06.039834 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a905f-a3d8-49ba-98e0-b3d0c9d6c3ea None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:06.083471 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74ede7-ef39-428a-9cca-085964c83cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:06.084424 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74ede7-ef39-428a-9cca-085964c83cb8 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:06.084936 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74ede7-ef39-428a-9cca-085964c83cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:06.085564 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74ede7-ef39-428a-9cca-085964c83cb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:06.111189 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:06.134416 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c1ed9-31a0-442e-8080-63d7e1fe4c12 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:06.173233 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74ede7-ef39-428a-9cca-085964c83cb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:06.175070 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74ede7-ef39-428a-9cca-085964c83cb8 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:06.180828 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6e979-efa8-4846-9f8a-6233aa60dac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:06.181437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6e979-efa8-4846-9f8a-6233aa60dac4 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:06.181711 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6e979-efa8-4846-9f8a-6233aa60dac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:06.181978 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6e979-efa8-4846-9f8a-6233aa60dac4 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:06.182635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6e979-efa8-4846-9f8a-6233aa60dac4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:06.183625 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6e979-efa8-4846-9f8a-6233aa60dac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:06.185381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6e979-efa8-4846-9f8a-6233aa60dac4 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:06.186542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:06.194644 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 103/193] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:06.195420 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6e979-efa8-4846-9f8a-6233aa60dac4 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:06.284921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 91/194] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:06.285686 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74ede7-ef39-428a-9cca-085964c83cb8 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:06.305216 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6e979-efa8-4846-9f8a-6233aa60dac4 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:06.339237 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872532b-aa53-4f67-9966-983525a32a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:06.339880 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872532b-aa53-4f67-9966-983525a32a4d None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:06.340441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872532b-aa53-4f67-9966-983525a32a4d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:06.340441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872532b-aa53-4f67-9966-983525a32a4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:06.341494 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872532b-aa53-4f67-9966-983525a32a4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:06.342922 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872532b-aa53-4f67-9966-983525a32a4d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:06.344514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 104/195] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:06.349186 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872532b-aa53-4f67-9966-983525a32a4d None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:06.350964 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:06.391179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74ede7-ef39-428a-9cca-085964c83cb8 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:06.402605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:06.426725 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b13e4d-b722-470c-9d60-7cdb450acefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:06.427313 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b13e4d-b722-470c-9d60-7cdb450acefa None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:06.427596 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b13e4d-b722-470c-9d60-7cdb450acefa None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:06.427877 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b13e4d-b722-470c-9d60-7cdb450acefa None admin] PATH_INFO: `/v3/users/843d300923b8449aa6452cbe47210f37` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:06.429018 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b13e4d-b722-470c-9d60-7cdb450acefa None admin] RBAC: Authorizing `identity:get_user(user_id=843d300923b8449aa6452cbe47210f37)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:06.430483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b13e4d-b722-470c-9d60-7cdb450acefa None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:06.432937 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 92/196] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:06 2022] GET /identity/v3/users/843d300923b8449aa6452cbe47210f37 => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:06.433994 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b13e4d-b722-470c-9d60-7cdb450acefa None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:06.450036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872532b-aa53-4f67-9966-983525a32a4d None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:06.484038 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb3dd7-069d-4b02-9c44-93bccf100554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:06.484663 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb3dd7-069d-4b02-9c44-93bccf100554 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:06.484940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb3dd7-069d-4b02-9c44-93bccf100554 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:06.485205 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb3dd7-069d-4b02-9c44-93bccf100554 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:06.494994 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb3dd7-069d-4b02-9c44-93bccf100554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-7aeb3dd7-069d-4b02-9c44-93bccf100554 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:06.500615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:06.501545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:06.502319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:06.502319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:06.502319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:06.502319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:06.502319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:06.502319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:06.502319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:06.502319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:06.502319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:06.502319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:06.502319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:06.502319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:06.502319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 105/197] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:06.502986 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb3dd7-069d-4b02-9c44-93bccf100554 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:06.540026 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b13e4d-b722-470c-9d60-7cdb450acefa None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:06.564505 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:06.573959 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ad118-58a7-427b-9008-1e07afc9ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:06.574586 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad118-58a7-427b-9008-1e07afc9ef6f None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:06.574859 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad118-58a7-427b-9008-1e07afc9ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:06.575129 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad118-58a7-427b-9008-1e07afc9ef6f None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:06.576295 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ad118-58a7-427b-9008-1e07afc9ef6f None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:06.578312 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ad118-58a7-427b-9008-1e07afc9ef6f None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:06.579994 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 93/198] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:06 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:06.580767 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ad118-58a7-427b-9008-1e07afc9ef6f None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:06.605685 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb3dd7-069d-4b02-9c44-93bccf100554 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:06.627513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:06.640754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40fe8-0af2-45dc-98a4-f39dacc92208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:06.641359 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40fe8-0af2-45dc-98a4-f39dacc92208 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:06.641637 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40fe8-0af2-45dc-98a4-f39dacc92208 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:06.641911 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40fe8-0af2-45dc-98a4-f39dacc92208 None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:06.642553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd40fe8-0af2-45dc-98a4-f39dacc92208 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:06.644034 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd40fe8-0af2-45dc-98a4-f39dacc92208 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:06.682094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ad118-58a7-427b-9008-1e07afc9ef6f None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:06.715204 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6a475-a1a7-4c78-b560-d38228250d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:06.715815 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6a475-a1a7-4c78-b560-d38228250d14 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:06.716128 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6a475-a1a7-4c78-b560-d38228250d14 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:06.716403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6a475-a1a7-4c78-b560-d38228250d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:06.746156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 106/199] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Aug 23 16:25:06 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:25:06.746816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40fe8-0af2-45dc-98a4-f39dacc92208 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:06.802586 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6a475-a1a7-4c78-b560-d38228250d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:06.804123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6a475-a1a7-4c78-b560-d38228250d14 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:06.858418 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:06.883011 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40fe8-0af2-45dc-98a4-f39dacc92208 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:06.906179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:06.924030 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 94/200] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:06.924030 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6a475-a1a7-4c78-b560-d38228250d14 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:06.928892 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b45c9-1f47-41ca-99ce-e018c15afe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:06.929529 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b45c9-1f47-41ca-99ce-e018c15afe4d None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:06.929857 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b45c9-1f47-41ca-99ce-e018c15afe4d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:06.930138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b45c9-1f47-41ca-99ce-e018c15afe4d None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:06.930931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b45c9-1f47-41ca-99ce-e018c15afe4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:06.931263 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b45c9-1f47-41ca-99ce-e018c15afe4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:06.932709 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b45c9-1f47-41ca-99ce-e018c15afe4d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:06.943082 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 107/201] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:06.943888 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b45c9-1f47-41ca-99ce-e018c15afe4d None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:07.057417 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6a475-a1a7-4c78-b560-d38228250d14 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:07.076370 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b45c9-1f47-41ca-99ce-e018c15afe4d None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:07.099308 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92718c2-6540-4a0d-9baf-03e07eba3cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:07.099927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92718c2-6540-4a0d-9baf-03e07eba3cc6 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:07.100208 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92718c2-6540-4a0d-9baf-03e07eba3cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:07.100482 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92718c2-6540-4a0d-9baf-03e07eba3cc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:07.101218 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92718c2-6540-4a0d-9baf-03e07eba3cc6 None admin] RBAC: Adding query filter params (role.id=091802a86e334e129210219b7c69359d, scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c, user.id=c758fcbb9efa4fe1a05bf329f726ca3c) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:07.101529 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92718c2-6540-4a0d-9baf-03e07eba3cc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:07.102991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92718c2-6540-4a0d-9baf-03e07eba3cc6 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:07.111364 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 95/202] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:06 2022] GET /identity/v3/role_assignments?user.id=c758fcbb9efa4fe1a05bf329f726ca3c&scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c&role.id=091802a86e334e129210219b7c69359d => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:07.112225 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92718c2-6540-4a0d-9baf-03e07eba3cc6 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:07.124184 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a3ae1-2bab-4692-b4e8-2fea9b250518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:07.125286 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a3ae1-2bab-4692-b4e8-2fea9b250518 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:07.125573 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a3ae1-2bab-4692-b4e8-2fea9b250518 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:07.125847 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a3ae1-2bab-4692-b4e8-2fea9b250518 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:07.127116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a3ae1-2bab-4692-b4e8-2fea9b250518 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:07.127331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:07.129119 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a3ae1-2bab-4692-b4e8-2fea9b250518 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:07.131301 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 108/203] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:06 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:07.137514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a3ae1-2bab-4692-b4e8-2fea9b250518 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:07.211101 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:07.281067 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a3ae1-2bab-4692-b4e8-2fea9b250518 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:07.298325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92718c2-6540-4a0d-9baf-03e07eba3cc6 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:07.340834 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40567ee2-ec29-444b-92bc-05c36bda26a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:07.341481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40567ee2-ec29-444b-92bc-05c36bda26a0 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:07.347254 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40567ee2-ec29-444b-92bc-05c36bda26a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:07.347254 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40567ee2-ec29-444b-92bc-05c36bda26a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:07.347254 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40567ee2-ec29-444b-92bc-05c36bda26a0 None admin] RBAC: Adding query filter params (role.id=225f2a2bd302418485ac34ecb871c3e4, scope.project.id=39c3c57ed064477baba507d8cda5eee4, user.id=843d300923b8449aa6452cbe47210f37) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:07.347254 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40567ee2-ec29-444b-92bc-05c36bda26a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:07.347254 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40567ee2-ec29-444b-92bc-05c36bda26a0 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:07.352832 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 109/204] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:07 2022] GET /identity/v3/role_assignments?user.id=843d300923b8449aa6452cbe47210f37&scope.project.id=39c3c57ed064477baba507d8cda5eee4&role.id=225f2a2bd302418485ac34ecb871c3e4 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:07.374836 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9254b0-7d2a-4c26-9b04-89b92e65ae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:07.375906 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9254b0-7d2a-4c26-9b04-89b92e65ae70 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:07.376388 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9254b0-7d2a-4c26-9b04-89b92e65ae70 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:07.376833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9254b0-7d2a-4c26-9b04-89b92e65ae70 None admin] PATH_INFO: `/v3/users/c758fcbb9efa4fe1a05bf329f726ca3c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:07.378413 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9254b0-7d2a-4c26-9b04-89b92e65ae70 None admin] RBAC: Authorizing `identity:get_user(user_id=c758fcbb9efa4fe1a05bf329f726ca3c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:07.380165 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9254b0-7d2a-4c26-9b04-89b92e65ae70 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:07.382421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 96/205] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:07 2022] GET /identity/v3/users/c758fcbb9efa4fe1a05bf329f726ca3c => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:07.388548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40567ee2-ec29-444b-92bc-05c36bda26a0 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:07.563482 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40567ee2-ec29-444b-92bc-05c36bda26a0 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:07.581514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:07.606117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f390f8e-6724-4d07-be51-9826ce9fe8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:07.607089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f390f8e-6724-4d07-be51-9826ce9fe8a4 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:07.607550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f390f8e-6724-4d07-be51-9826ce9fe8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:07.612961 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f390f8e-6724-4d07-be51-9826ce9fe8a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:07.680326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f390f8e-6724-4d07-be51-9826ce9fe8a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:07.682203 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f390f8e-6724-4d07-be51-9826ce9fe8a4 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:07.798636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 110/206] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:07.804428 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9254b0-7d2a-4c26-9b04-89b92e65ae70 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:07.890499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:07.914297 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9254b0-7d2a-4c26-9b04-89b92e65ae70 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:07.956339 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5350113-a202-4da4-8923-bbd857839305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:07.956989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5350113-a202-4da4-8923-bbd857839305 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:07.957265 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5350113-a202-4da4-8923-bbd857839305 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:07.957538 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5350113-a202-4da4-8923-bbd857839305 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:07.958677 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5350113-a202-4da4-8923-bbd857839305 None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:07.960202 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5350113-a202-4da4-8923-bbd857839305 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:07.961843 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 97/207] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:07 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:07.968583 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f390f8e-6724-4d07-be51-9826ce9fe8a4 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:07.985164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:08.076729 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f390f8e-6724-4d07-be51-9826ce9fe8a4 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:08.114525 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89f62f-b65b-41f0-9f5f-e8ffe8a6c400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:08.115138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89f62f-b65b-41f0-9f5f-e8ffe8a6c400 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:08.115491 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89f62f-b65b-41f0-9f5f-e8ffe8a6c400 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:08.115764 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89f62f-b65b-41f0-9f5f-e8ffe8a6c400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:08.116543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89f62f-b65b-41f0-9f5f-e8ffe8a6c400 None admin] RBAC: Adding query filter params (role.id=1f86135571074da38ac7d898436a8862, scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c, user.id=c758fcbb9efa4fe1a05bf329f726ca3c) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:08.116851 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89f62f-b65b-41f0-9f5f-e8ffe8a6c400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:08.118368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89f62f-b65b-41f0-9f5f-e8ffe8a6c400 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:08.124491 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 111/208] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:07 2022] GET /identity/v3/role_assignments?user.id=c758fcbb9efa4fe1a05bf329f726ca3c&scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c&role.id=1f86135571074da38ac7d898436a8862 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:09.321357 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2e0cf-111b-4c23-8595-f53b90e1d125 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.321883 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2e0cf-111b-4c23-8595-f53b90e1d125 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.321883 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2e0cf-111b-4c23-8595-f53b90e1d125 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.323499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 98/209] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:09.329452 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64b0ca-cd94-4c42-b3ee-f98a0abd5b20 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.330350 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64b0ca-cd94-4c42-b3ee-f98a0abd5b20 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.330816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64b0ca-cd94-4c42-b3ee-f98a0abd5b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.351145 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-ec64b0ca-cd94-4c42-b3ee-f98a0abd5b20 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:09.352756 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-ec64b0ca-cd94-4c42-b3ee-f98a0abd5b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:09.430170 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 112/210] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:09.466440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffefbe-d3b1-491e-af8d-429f94c3f17f None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.467057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffefbe-d3b1-491e-af8d-429f94c3f17f None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.468111 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffefbe-d3b1-491e-af8d-429f94c3f17f None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.469676 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 99/211] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:09.477221 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2361d9-4fd4-461f-98ea-eca3314941b0 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.477825 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2361d9-4fd4-461f-98ea-eca3314941b0 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.478289 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2361d9-4fd4-461f-98ea-eca3314941b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.499218 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-7a2361d9-4fd4-461f-98ea-eca3314941b0 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:09.500810 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-7a2361d9-4fd4-461f-98ea-eca3314941b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:09.503285 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:09.583455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 113/212] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:09.686470 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401f7ad-f769-4034-9360-a17818ab64c0 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.686805 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401f7ad-f769-4034-9360-a17818ab64c0 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.687021 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401f7ad-f769-4034-9360-a17818ab64c0 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.688432 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 100/213] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:09.693841 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62330ed8-3b5f-493f-818f-1a4f77126060 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.694124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62330ed8-3b5f-493f-818f-1a4f77126060 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.694402 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62330ed8-3b5f-493f-818f-1a4f77126060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.713091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-62330ed8-3b5f-493f-818f-1a4f77126060 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:09.714275 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-62330ed8-3b5f-493f-818f-1a4f77126060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:09.779538 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401f7ad-f769-4034-9360-a17818ab64c0 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:09.794365 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 114/214] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:09.892713 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401f7ad-f769-4034-9360-a17818ab64c0 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:09.929322 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9541ba-2367-4e4e-ae84-4372d3fbaaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:09.929960 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9541ba-2367-4e4e-ae84-4372d3fbaaab None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.930239 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9541ba-2367-4e4e-ae84-4372d3fbaaab None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.930510 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9541ba-2367-4e4e-ae84-4372d3fbaaab None admin] PATH_INFO: `/v3/domains/default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.931646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9541ba-2367-4e4e-ae84-4372d3fbaaab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:09.933147 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9541ba-2367-4e4e-ae84-4372d3fbaaab None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:09.935150 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 101/215] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:09.940559 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62330ed8-3b5f-493f-818f-1a4f77126060 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:09.946649 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9541ba-2367-4e4e-ae84-4372d3fbaaab None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:09.958187 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:10.016357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:10.048742 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9541ba-2367-4e4e-ae84-4372d3fbaaab None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:10.053707 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62330ed8-3b5f-493f-818f-1a4f77126060 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:10.085224 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fbf3-64e6-4914-8196-bec71308c917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:10.085864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fbf3-64e6-4914-8196-bec71308c917 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:10.086139 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fbf3-64e6-4914-8196-bec71308c917 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:10.086625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fbf3-64e6-4914-8196-bec71308c917 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:10.097434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40fbf3-64e6-4914-8196-bec71308c917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:10.098214 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead2d2-7219-4e36-a236-927d75a5a6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:10.099085 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead2d2-7219-4e36-a236-927d75a5a6f8 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:10.099577 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead2d2-7219-4e36-a236-927d75a5a6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:10.100034 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead2d2-7219-4e36-a236-927d75a5a6f8 None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:10.100896 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbead2d2-7219-4e36-a236-927d75a5a6f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:10.102551 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbead2d2-7219-4e36-a236-927d75a5a6f8 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-5d40fbf3-64e6-4914-8196-bec71308c917 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:10.102833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:10.103748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:10.104618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:10.104618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:10.104618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:10.104618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:10.104618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:10.104618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:10.104618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:10.104618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:10.104618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:10.104618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:10.104618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:10.104618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:10.104618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 102/216] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:10.110219 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fbf3-64e6-4914-8196-bec71308c917 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:10.181756 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 115/217] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Aug 23 16:25:09 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:25:10.182483 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead2d2-7219-4e36-a236-927d75a5a6f8 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:10.207763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:10.254943 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fbf3-64e6-4914-8196-bec71308c917 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:10.305673 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb2b07-5e0b-44d1-859f-dd499d31bf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:10.307069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb2b07-5e0b-44d1-859f-dd499d31bf32 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:10.307573 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb2b07-5e0b-44d1-859f-dd499d31bf32 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:10.308042 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb2b07-5e0b-44d1-859f-dd499d31bf32 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:10.309196 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb2b07-5e0b-44d1-859f-dd499d31bf32 None admin] RBAC: Adding query filter params (name=member) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:10.310261 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb2b07-5e0b-44d1-859f-dd499d31bf32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:10.312769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb2b07-5e0b-44d1-859f-dd499d31bf32 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:10.317105 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead2d2-7219-4e36-a236-927d75a5a6f8 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:10.326398 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 103/218] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:10.334948 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb2b07-5e0b-44d1-859f-dd499d31bf32 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:10.351005 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:10.363451 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f0b5c-106f-42c4-afe8-4da3a9668e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:10.366445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f0b5c-106f-42c4-afe8-4da3a9668e12 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:10.366445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f0b5c-106f-42c4-afe8-4da3a9668e12 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:10.366445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f0b5c-106f-42c4-afe8-4da3a9668e12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:10.381442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f0b5c-106f-42c4-afe8-4da3a9668e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-3f3f0b5c-106f-42c4-afe8-4da3a9668e12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:10.387149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:10.388060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:10.388843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:10.388843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:10.388843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:10.388843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:10.388843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:10.388843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:10.388843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:10.388843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:10.388843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:10.388843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:10.388843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:10.388843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:10.388843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 116/219] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:25:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:10.391535 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9d521-0160-4a72-9162-56c406c7bbe1 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:10.391855 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9d521-0160-4a72-9162-56c406c7bbe1 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:10.392130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9d521-0160-4a72-9162-56c406c7bbe1 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:10.393481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 117/220] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:10.400275 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9d521-0160-4a72-9162-56c406c7bbe1 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:10.458750 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb2b07-5e0b-44d1-859f-dd499d31bf32 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:10.497210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205524cd-57f6-429b-98b9-48ce54497543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:10.497873 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205524cd-57f6-429b-98b9-48ce54497543 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:10.498150 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205524cd-57f6-429b-98b9-48ce54497543 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:10.498429 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205524cd-57f6-429b-98b9-48ce54497543 None admin] PATH_INFO: `/v3/users/a22a920d57654d83a1bf41be5bef2adc` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:10.502903 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:10.517572 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205524cd-57f6-429b-98b9-48ce54497543 None admin] RBAC: Authorizing `identity:get_user(user_id=a22a920d57654d83a1bf41be5bef2adc)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:10.519426 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205524cd-57f6-429b-98b9-48ce54497543 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:10.521126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 104/221] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:10 2022] GET /identity/v3/users/a22a920d57654d83a1bf41be5bef2adc => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:10.522379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e3a77-39c4-49d1-84d9-7d36dd9ac3db None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:10.522653 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e3a77-39c4-49d1-84d9-7d36dd9ac3db None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:10.522922 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e3a77-39c4-49d1-84d9-7d36dd9ac3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:10.548005 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-807e3a77-39c4-49d1-84d9-7d36dd9ac3db None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:10.549210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-807e3a77-39c4-49d1-84d9-7d36dd9ac3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:10.592577 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9d521-0160-4a72-9162-56c406c7bbe1 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:10.627674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 105/222] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:10.628481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e3a77-39c4-49d1-84d9-7d36dd9ac3db None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:10.639326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50267f2c-c890-425f-8d7c-f258659eca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:10.640427 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50267f2c-c890-425f-8d7c-f258659eca95 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:10.640709 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50267f2c-c890-425f-8d7c-f258659eca95 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:10.640985 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50267f2c-c890-425f-8d7c-f258659eca95 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:10.642058 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50267f2c-c890-425f-8d7c-f258659eca95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:10.642368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50267f2c-c890-425f-8d7c-f258659eca95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:10.644075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50267f2c-c890-425f-8d7c-f258659eca95 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:10.656812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 118/223] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:10.662349 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50267f2c-c890-425f-8d7c-f258659eca95 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:10.731692 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:10.747489 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e3a77-39c4-49d1-84d9-7d36dd9ac3db None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:10.785235 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:10.798493 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff1e92-be90-49f8-a824-76b70d47db43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:10.799424 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff1e92-be90-49f8-a824-76b70d47db43 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:10.800126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff1e92-be90-49f8-a824-76b70d47db43 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:10.800126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff1e92-be90-49f8-a824-76b70d47db43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:10.800908 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50267f2c-c890-425f-8d7c-f258659eca95 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:10.844877 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a3b42-1f34-49a6-b01d-79d8aec3832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:10.845182 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a3b42-1f34-49a6-b01d-79d8aec3832a None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:10.845578 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a3b42-1f34-49a6-b01d-79d8aec3832a None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:10.846238 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a3b42-1f34-49a6-b01d-79d8aec3832a None admin] PATH_INFO: `/v3/users/c758fcbb9efa4fe1a05bf329f726ca3c` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:10.847198 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a3b42-1f34-49a6-b01d-79d8aec3832a None admin] RBAC: Authorizing `identity:get_user(user_id=c758fcbb9efa4fe1a05bf329f726ca3c)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:10.848722 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a3b42-1f34-49a6-b01d-79d8aec3832a None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:10.850897 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 119/224] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:10 2022] GET /identity/v3/users/c758fcbb9efa4fe1a05bf329f726ca3c => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:10.857815 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a3b42-1f34-49a6-b01d-79d8aec3832a None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:10.885377 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff1e92-be90-49f8-a824-76b70d47db43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:10.887624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff1e92-be90-49f8-a824-76b70d47db43 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:10.991978 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a3b42-1f34-49a6-b01d-79d8aec3832a None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:11.007317 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:11.029252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf44b60-57be-4f77-a56b-8a0b38377c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:11.030432 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf44b60-57be-4f77-a56b-8a0b38377c23 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:11.030711 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf44b60-57be-4f77-a56b-8a0b38377c23 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:11.031035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf44b60-57be-4f77-a56b-8a0b38377c23 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:11.032218 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf44b60-57be-4f77-a56b-8a0b38377c23 None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:11.033678 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf44b60-57be-4f77-a56b-8a0b38377c23 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:11.035536 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 120/225] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:10 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:11.041133 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf44b60-57be-4f77-a56b-8a0b38377c23 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:11.057316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 106/226] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:11.062410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff1e92-be90-49f8-a824-76b70d47db43 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:11.116327 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:11.150019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf44b60-57be-4f77-a56b-8a0b38377c23 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:11.186533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbdb2e-cbdc-477a-a63c-577bbb4e2b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:11.187195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbdb2e-cbdc-477a-a63c-577bbb4e2b58 None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:11.187501 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbdb2e-cbdc-477a-a63c-577bbb4e2b58 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:11.187781 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbdb2e-cbdc-477a-a63c-577bbb4e2b58 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c/users/c758fcbb9efa4fe1a05bf329f726ca3c/roles/091802a86e334e129210219b7c69359d` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:11.189725 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbdb2e-cbdc-477a-a63c-577bbb4e2b58 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b3e0cdb32043e499f5197ea0bfea1c, user_id=c758fcbb9efa4fe1a05bf329f726ca3c, role_id=091802a86e334e129210219b7c69359d)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:11.191263 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbdb2e-cbdc-477a-a63c-577bbb4e2b58 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:11.214900 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff1e92-be90-49f8-a824-76b70d47db43 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:11.252456 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525c526-0608-40a4-87b6-7ea50207ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:11.253176 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525c526-0608-40a4-87b6-7ea50207ef25 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:11.253452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525c526-0608-40a4-87b6-7ea50207ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:11.253723 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525c526-0608-40a4-87b6-7ea50207ef25 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:11.254849 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525c526-0608-40a4-87b6-7ea50207ef25 None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:11.256313 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525c526-0608-40a4-87b6-7ea50207ef25 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:11.258117 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 107/227] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:11 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:11.258707 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525c526-0608-40a4-87b6-7ea50207ef25 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:11.309006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 121/228] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:25:11 2022] PUT /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c/users/c758fcbb9efa4fe1a05bf329f726ca3c/roles/091802a86e334e129210219b7c69359d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:25:11.310349 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbdb2e-cbdc-477a-a63c-577bbb4e2b58 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:11.376327 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:11.468428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbdb2e-cbdc-477a-a63c-577bbb4e2b58 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:11.473686 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:11.513578 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525c526-0608-40a4-87b6-7ea50207ef25 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:11.514896 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84e421-0243-4c91-840c-2eb6423b0d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:11.515951 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84e421-0243-4c91-840c-2eb6423b0d6b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:11.516428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84e421-0243-4c91-840c-2eb6423b0d6b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:11.516888 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84e421-0243-4c91-840c-2eb6423b0d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:11.518127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84e421-0243-4c91-840c-2eb6423b0d6b None admin] RBAC: Adding query filter params (role.id=4bc1625db2f14e779d8acb4d21d9d3f1, scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c, user.id=a22a920d57654d83a1bf41be5bef2adc) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:11.518679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84e421-0243-4c91-840c-2eb6423b0d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:11.520364 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84e421-0243-4c91-840c-2eb6423b0d6b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:11.527901 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 122/229] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:11 2022] GET /identity/v3/role_assignments?user.id=a22a920d57654d83a1bf41be5bef2adc&scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c&role.id=4bc1625db2f14e779d8acb4d21d9d3f1 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:11.657134 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512c672-2bf4-484c-b935-7085d6eac486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:11.657756 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512c672-2bf4-484c-b935-7085d6eac486 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:11.658028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512c672-2bf4-484c-b935-7085d6eac486 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:11.658302 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512c672-2bf4-484c-b935-7085d6eac486 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:11.679301 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512c672-2bf4-484c-b935-7085d6eac486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-a512c672-2bf4-484c-b935-7085d6eac486 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:11.692955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:11.693919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:11.694738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:11.694738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:11.694738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:11.694738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:11.694738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:11.694738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:11.694738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:11.694738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:11.694738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:11.694738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:11.694738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:11.694738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:11.694738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 108/230] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:25:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:11.695413 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84e421-0243-4c91-840c-2eb6423b0d6b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:11.865035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84e421-0243-4c91-840c-2eb6423b0d6b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:11.874992 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:11.913217 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da72144-0bbc-45ef-a844-ab4f12a5c4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:11.914271 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da72144-0bbc-45ef-a844-ab4f12a5c4ca None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:11.914748 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da72144-0bbc-45ef-a844-ab4f12a5c4ca None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:11.915252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da72144-0bbc-45ef-a844-ab4f12a5c4ca None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:11.917034 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da72144-0bbc-45ef-a844-ab4f12a5c4ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:11.918110 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da72144-0bbc-45ef-a844-ab4f12a5c4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:11.920040 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da72144-0bbc-45ef-a844-ab4f12a5c4ca None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:11.934647 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 123/231] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:11.941397 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512c672-2bf4-484c-b935-7085d6eac486 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:12.188998 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512c672-2bf4-484c-b935-7085d6eac486 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:12.284137 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b686c-17e4-4729-b664-0e6f44acc5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:12.284835 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b686c-17e4-4729-b664-0e6f44acc5a5 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:12.290272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b686c-17e4-4729-b664-0e6f44acc5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:12.290272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b686c-17e4-4729-b664-0e6f44acc5a5 None admin] PATH_INFO: `/v3/users/c758fcbb9efa4fe1a05bf329f726ca3c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:12.290272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b686c-17e4-4729-b664-0e6f44acc5a5 None admin] RBAC: Authorizing `identity:get_user(user_id=c758fcbb9efa4fe1a05bf329f726ca3c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:12.290272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b686c-17e4-4729-b664-0e6f44acc5a5 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:12.290272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 109/232] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:11 2022] GET /identity/v3/users/c758fcbb9efa4fe1a05bf329f726ca3c => generated 283 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:12.296517 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da72144-0bbc-45ef-a844-ab4f12a5c4ca None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:12.455583 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da72144-0bbc-45ef-a844-ab4f12a5c4ca None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:12.508285 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790c589-b033-49c1-bcec-bf59c086893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:12.509310 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c589-b033-49c1-bcec-bf59c086893e None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:12.509793 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c589-b033-49c1-bcec-bf59c086893e None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:12.510281 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c589-b033-49c1-bcec-bf59c086893e None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:12.516009 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790c589-b033-49c1-bcec-bf59c086893e None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:12.517795 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790c589-b033-49c1-bcec-bf59c086893e None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:12.520150 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 124/233] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:12 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:12.526050 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b686c-17e4-4729-b664-0e6f44acc5a5 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:12.570519 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:12.684551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b686c-17e4-4729-b664-0e6f44acc5a5 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:12.741277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce61ce-bb87-41ed-ab9d-b1aff5e1098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:12.741868 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce61ce-bb87-41ed-ab9d-b1aff5e1098c None admin] REQUEST_METHOD: `PUT` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:12.742145 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce61ce-bb87-41ed-ab9d-b1aff5e1098c None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:12.742418 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce61ce-bb87-41ed-ab9d-b1aff5e1098c None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c/users/c758fcbb9efa4fe1a05bf329f726ca3c/roles/1f86135571074da38ac7d898436a8862` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:12.747531 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce61ce-bb87-41ed-ab9d-b1aff5e1098c None admin] RBAC: Authorizing `identity:create_grant(project_id=40b3e0cdb32043e499f5197ea0bfea1c, user_id=c758fcbb9efa4fe1a05bf329f726ca3c, role_id=1f86135571074da38ac7d898436a8862)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:12.748660 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce61ce-bb87-41ed-ab9d-b1aff5e1098c None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:12.833259 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 110/234] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:25:12 2022] PUT /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c/users/c758fcbb9efa4fe1a05bf329f726ca3c/roles/1f86135571074da38ac7d898436a8862 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:25:13.189198 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e2746-ef93-45f3-afff-bff60624b8e8 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:13.189945 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e2746-ef93-45f3-afff-bff60624b8e8 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:13.190438 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e2746-ef93-45f3-afff-bff60624b8e8 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:13.192167 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 125/235] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:13.208233 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99462b-8099-47dc-aad8-363c7e7f61b2 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:13.208541 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99462b-8099-47dc-aad8-363c7e7f61b2 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:13.208787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99462b-8099-47dc-aad8-363c7e7f61b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:13.229558 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-ec99462b-8099-47dc-aad8-363c7e7f61b2 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:13.230825 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-ec99462b-8099-47dc-aad8-363c7e7f61b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:13.233832 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48048e57-4b4d-4b3b-b822-7795807dc7bf None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:13.234375 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48048e57-4b4d-4b3b-b822-7795807dc7bf None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:13.234719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48048e57-4b4d-4b3b-b822-7795807dc7bf None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:13.236351 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 126/236] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:25:13.241856 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35a2db-670f-4f64-9c94-740061224a63 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:13.242209 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35a2db-670f-4f64-9c94-740061224a63 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:13.242580 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35a2db-670f-4f64-9c94-740061224a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:13.273378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-fc35a2db-670f-4f64-9c94-740061224a63 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:13.275486 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-fc35a2db-670f-4f64-9c94-740061224a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:13.318670 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:13.319869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 111/237] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:13.357090 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 127/238] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:13.724917 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99462b-8099-47dc-aad8-363c7e7f61b2 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:13.738824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:13.801940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35a2db-670f-4f64-9c94-740061224a63 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:13.882194 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99462b-8099-47dc-aad8-363c7e7f61b2 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:13.922152 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648ae8a-49da-4aef-ab09-37a46366b888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:13.923176 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648ae8a-49da-4aef-ab09-37a46366b888 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:13.923482 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648ae8a-49da-4aef-ab09-37a46366b888 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:13.923757 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648ae8a-49da-4aef-ab09-37a46366b888 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:13.936240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648ae8a-49da-4aef-ab09-37a46366b888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-6648ae8a-49da-4aef-ab09-37a46366b888 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:13.941751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:13.942696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:13.943555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:13.943555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:13.943555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:13.943555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:13.943555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:13.943555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:13.943555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:13.943555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:13.943555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:13.943555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:13.943555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:13.943555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:13.943555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 112/239] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:13.951487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648ae8a-49da-4aef-ab09-37a46366b888 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:13.981766 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35a2db-670f-4f64-9c94-740061224a63 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:14.039548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6dd51-ad08-422a-a6be-6c67c213287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:14.040436 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6dd51-ad08-422a-a6be-6c67c213287e None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:14.040886 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6dd51-ad08-422a-a6be-6c67c213287e None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:14.041303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6dd51-ad08-422a-a6be-6c67c213287e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:14.043392 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6dd51-ad08-422a-a6be-6c67c213287e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:14.045008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6dd51-ad08-422a-a6be-6c67c213287e None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:14.048126 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 128/240] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:14.056317 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6dd51-ad08-422a-a6be-6c67c213287e None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:14.098052 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:14.117127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:14.147529 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648ae8a-49da-4aef-ab09-37a46366b888 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:14.188439 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ccd20-ff1c-44a1-9a6f-b0c084c84ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:14.189792 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ccd20-ff1c-44a1-9a6f-b0c084c84ef8 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:14.190070 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ccd20-ff1c-44a1-9a6f-b0c084c84ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:14.190562 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ccd20-ff1c-44a1-9a6f-b0c084c84ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:14.191296 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ccd20-ff1c-44a1-9a6f-b0c084c84ef8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:14.191781 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ccd20-ff1c-44a1-9a6f-b0c084c84ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:14.193407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ccd20-ff1c-44a1-9a6f-b0c084c84ef8 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:14.205207 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 113/241] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:14.211967 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ccd20-ff1c-44a1-9a6f-b0c084c84ef8 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:14.269590 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6dd51-ad08-422a-a6be-6c67c213287e None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:14.352211 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd2bae-bb9b-4b51-8419-c4b6157176a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:14.352840 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2bae-bb9b-4b51-8419-c4b6157176a0 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:14.353114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2bae-bb9b-4b51-8419-c4b6157176a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:14.353385 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2bae-bb9b-4b51-8419-c4b6157176a0 None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:14.354035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd2bae-bb9b-4b51-8419-c4b6157176a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:14.355494 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd2bae-bb9b-4b51-8419-c4b6157176a0 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:14.390430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ccd20-ff1c-44a1-9a6f-b0c084c84ef8 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:14.429516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:14.435673 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5fab1-13a0-416c-8cb1-06aa43cc5b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:14.436767 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5fab1-13a0-416c-8cb1-06aa43cc5b8d None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:14.437203 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5fab1-13a0-416c-8cb1-06aa43cc5b8d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:14.437746 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5fab1-13a0-416c-8cb1-06aa43cc5b8d None admin] PATH_INFO: `/v3/users/483f52386e684f6ca605bcce5c122389` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:14.459650 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5fab1-13a0-416c-8cb1-06aa43cc5b8d None admin] RBAC: Authorizing `identity:get_user(user_id=483f52386e684f6ca605bcce5c122389)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:14.462074 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5fab1-13a0-416c-8cb1-06aa43cc5b8d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:14.464758 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 114/242] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:14 2022] GET /identity/v3/users/483f52386e684f6ca605bcce5c122389 => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:14.471326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17a67c-4242-40c5-9a98-d8165557d712 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:14.471326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17a67c-4242-40c5-9a98-d8165557d712 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:14.471326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17a67c-4242-40c5-9a98-d8165557d712 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:14.472608 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 115/243] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:14.473725 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17a67c-4242-40c5-9a98-d8165557d712 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:14.499660 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 129/244] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Aug 23 16:25:14 2022] POST /identity/v3/users => generated 293 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:25:14.501807 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396236-4caf-4fb7-aa51-0422e157ffc4 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:14.502230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396236-4caf-4fb7-aa51-0422e157ffc4 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:14.502638 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396236-4caf-4fb7-aa51-0422e157ffc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:14.548386 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-f0396236-4caf-4fb7-aa51-0422e157ffc4 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:14.549639 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-f0396236-4caf-4fb7-aa51-0422e157ffc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:14.619622 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17a67c-4242-40c5-9a98-d8165557d712 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:14.627063 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 130/245] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:14.636896 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbbf12-bc0c-4551-bb98-3a9b52f7a528 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:14.637258 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbbf12-bc0c-4551-bb98-3a9b52f7a528 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:14.637546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbbf12-bc0c-4551-bb98-3a9b52f7a528 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:14.639797 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 131/246] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:14 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:14.645299 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be160f6-8a5a-46c4-a23b-dc0252d9da8f None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:14.645623 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be160f6-8a5a-46c4-a23b-dc0252d9da8f None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:14.645836 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be160f6-8a5a-46c4-a23b-dc0252d9da8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:14.667861 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128345c7-8f11-4dac-94a7-c8ac58d22de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:14.668911 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128345c7-8f11-4dac-94a7-c8ac58d22de4 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:14.669412 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128345c7-8f11-4dac-94a7-c8ac58d22de4 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:14.669942 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128345c7-8f11-4dac-94a7-c8ac58d22de4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:14.677776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-7be160f6-8a5a-46c4-a23b-dc0252d9da8f None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:14.682885 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-7be160f6-8a5a-46c4-a23b-dc0252d9da8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:14.717482 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:14.762415 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:14.777890 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128345c7-8f11-4dac-94a7-c8ac58d22de4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:14.779158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128345c7-8f11-4dac-94a7-c8ac58d22de4 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:14.816001 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 132/247] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:14.942703 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 116/248] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:14.948686 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be160f6-8a5a-46c4-a23b-dc0252d9da8f None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:15.088838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be160f6-8a5a-46c4-a23b-dc0252d9da8f None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:15.099386 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128345c7-8f11-4dac-94a7-c8ac58d22de4 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:15.136238 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb363c-9bd9-46bd-b369-e9521f224460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:15.136927 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb363c-9bd9-46bd-b369-e9521f224460 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:15.137209 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb363c-9bd9-46bd-b369-e9521f224460 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:15.137487 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb363c-9bd9-46bd-b369-e9521f224460 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:15.138721 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb363c-9bd9-46bd-b369-e9521f224460 None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:15.140812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb363c-9bd9-46bd-b369-e9521f224460 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:15.143031 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 133/249] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:14 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:15.149419 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb363c-9bd9-46bd-b369-e9521f224460 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:15.211625 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:15.259676 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:15.274461 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128345c7-8f11-4dac-94a7-c8ac58d22de4 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:15.323792 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63172b-0e42-4264-b994-0c11e26a4bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:15.324441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63172b-0e42-4264-b994-0c11e26a4bcd None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:15.324717 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63172b-0e42-4264-b994-0c11e26a4bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:15.324987 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63172b-0e42-4264-b994-0c11e26a4bcd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:15.326408 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb363c-9bd9-46bd-b369-e9521f224460 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:15.340696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63172b-0e42-4264-b994-0c11e26a4bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-0f63172b-0e42-4264-b994-0c11e26a4bcd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:15.350338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:15.351330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:15.352123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:15.352123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:15.352123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:15.352123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:15.352123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:15.352123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:15.352123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:15.352123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:15.352123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:15.352123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:15.352123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:15.352123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:15.356901 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 117/250] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:15.359759 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63172b-0e42-4264-b994-0c11e26a4bcd None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:15.382627 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa865c-e39c-4dd4-9e28-97464feaeb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:15.383673 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa865c-e39c-4dd4-9e28-97464feaeb31 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:15.384214 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa865c-e39c-4dd4-9e28-97464feaeb31 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:15.384711 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa865c-e39c-4dd4-9e28-97464feaeb31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:15.386232 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa865c-e39c-4dd4-9e28-97464feaeb31 None admin] RBAC: Adding query filter params (role.id=225f2a2bd302418485ac34ecb871c3e4, scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c, user.id=483f52386e684f6ca605bcce5c122389) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:15.386807 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa865c-e39c-4dd4-9e28-97464feaeb31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:15.388544 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa865c-e39c-4dd4-9e28-97464feaeb31 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:15.397426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 134/251] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:15 2022] GET /identity/v3/role_assignments?user.id=483f52386e684f6ca605bcce5c122389&scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c&role.id=225f2a2bd302418485ac34ecb871c3e4 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:15.399823 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa865c-e39c-4dd4-9e28-97464feaeb31 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:15.636978 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:15.655160 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63172b-0e42-4264-b994-0c11e26a4bcd None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:15.692563 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa865c-e39c-4dd4-9e28-97464feaeb31 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:15.733948 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46e8eb-f829-41ca-a3d2-092a42bfdf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:15.735008 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46e8eb-f829-41ca-a3d2-092a42bfdf1f None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:15.735523 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46e8eb-f829-41ca-a3d2-092a42bfdf1f None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:15.735998 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46e8eb-f829-41ca-a3d2-092a42bfdf1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:15.744752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f74dc-30de-4c39-a107-50b75f519bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:15.747983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f74dc-30de-4c39-a107-50b75f519bd0 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:15.747983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f74dc-30de-4c39-a107-50b75f519bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:15.747983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f74dc-30de-4c39-a107-50b75f519bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:15.747983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f74dc-30de-4c39-a107-50b75f519bd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:15.747983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f74dc-30de-4c39-a107-50b75f519bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:15.748421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f74dc-30de-4c39-a107-50b75f519bd0 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:15.758395 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 135/252] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:15.764374 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46e8eb-f829-41ca-a3d2-092a42bfdf1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:15.768883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f74dc-30de-4c39-a107-50b75f519bd0 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-bd46e8eb-f829-41ca-a3d2-092a42bfdf1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:15.778646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:15.779924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:15.780727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:15.780727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:15.780727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:15.780727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:15.780727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:15.780727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:15.780727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:15.780727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:15.780727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:15.780727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:15.780727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:15.780727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:15.782945 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 118/253] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:15.793194 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46e8eb-f829-41ca-a3d2-092a42bfdf1f None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:15.847718 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:15.923884 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46e8eb-f829-41ca-a3d2-092a42bfdf1f None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:15.971270 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9283a-c72a-48f5-bd50-0bc5e2feb929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:15.971916 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9283a-c72a-48f5-bd50-0bc5e2feb929 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:15.972192 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9283a-c72a-48f5-bd50-0bc5e2feb929 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:15.972462 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9283a-c72a-48f5-bd50-0bc5e2feb929 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:15.973139 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9283a-c72a-48f5-bd50-0bc5e2feb929 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:15.973445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9283a-c72a-48f5-bd50-0bc5e2feb929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:15.974824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9283a-c72a-48f5-bd50-0bc5e2feb929 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:16.004543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f74dc-30de-4c39-a107-50b75f519bd0 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:16.009497 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 119/254] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:16.019254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a863877-62bf-4084-865c-7abd53f1cffa None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:16.019254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a863877-62bf-4084-865c-7abd53f1cffa None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:16.019254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a863877-62bf-4084-865c-7abd53f1cffa None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:16.019254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 120/255] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:16.022815 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937158d-8ed7-4a6d-80a6-eea6391ea664 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:16.023098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937158d-8ed7-4a6d-80a6-eea6391ea664 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:16.023399 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937158d-8ed7-4a6d-80a6-eea6391ea664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:16.058926 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-9937158d-8ed7-4a6d-80a6-eea6391ea664 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:16.063273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-9937158d-8ed7-4a6d-80a6-eea6391ea664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:16.091845 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90048c36-a179-469f-a21c-43cb715db461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:16.093470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90048c36-a179-469f-a21c-43cb715db461 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:16.094159 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90048c36-a179-469f-a21c-43cb715db461 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:16.094837 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90048c36-a179-469f-a21c-43cb715db461 None admin] PATH_INFO: `/v3/users/a22a920d57654d83a1bf41be5bef2adc` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:16.097900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90048c36-a179-469f-a21c-43cb715db461 None admin] RBAC: Authorizing `identity:get_user(user_id=a22a920d57654d83a1bf41be5bef2adc)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:16.101247 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90048c36-a179-469f-a21c-43cb715db461 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:16.103724 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 136/256] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:15 2022] GET /identity/v3/users/a22a920d57654d83a1bf41be5bef2adc => generated 297 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:16.111681 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90048c36-a179-469f-a21c-43cb715db461 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:16.139971 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:16.190487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 121/257] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:16.191211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937158d-8ed7-4a6d-80a6-eea6391ea664 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:16.193719 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:16.315197 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90048c36-a179-469f-a21c-43cb715db461 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:16.328298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937158d-8ed7-4a6d-80a6-eea6391ea664 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:16.375176 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4609320-b8b7-4c91-8a17-c0e76b84ed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:16.376409 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4609320-b8b7-4c91-8a17-c0e76b84ed21 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:16.377371 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4609320-b8b7-4c91-8a17-c0e76b84ed21 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:16.378131 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b336c-3ff2-4018-9a62-9ed451f4b776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:16.378864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4609320-b8b7-4c91-8a17-c0e76b84ed21 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:16.379475 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b336c-3ff2-4018-9a62-9ed451f4b776 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:16.380462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b336c-3ff2-4018-9a62-9ed451f4b776 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:16.381231 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4609320-b8b7-4c91-8a17-c0e76b84ed21 None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:16.381653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b336c-3ff2-4018-9a62-9ed451f4b776 None admin] PATH_INFO: `/v3/users/c758fcbb9efa4fe1a05bf329f726ca3c` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:16.383867 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4609320-b8b7-4c91-8a17-c0e76b84ed21 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:16.384670 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b336c-3ff2-4018-9a62-9ed451f4b776 None admin] RBAC: Authorizing `identity:get_user(user_id=c758fcbb9efa4fe1a05bf329f726ca3c)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:16.386273 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b336c-3ff2-4018-9a62-9ed451f4b776 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:16.391176 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 122/258] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:16 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:16.396533 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4609320-b8b7-4c91-8a17-c0e76b84ed21 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:16.397446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 137/259] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:16 2022] GET /identity/v3/users/c758fcbb9efa4fe1a05bf329f726ca3c => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:16.402740 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b336c-3ff2-4018-9a62-9ed451f4b776 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:16.512992 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:16.533871 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:16.534805 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b336c-3ff2-4018-9a62-9ed451f4b776 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:16.576932 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9996e66-7fc5-434d-ba25-35b384ab8cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:16.577579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9996e66-7fc5-434d-ba25-35b384ab8cc4 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:16.577856 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9996e66-7fc5-434d-ba25-35b384ab8cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:16.578127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9996e66-7fc5-434d-ba25-35b384ab8cc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:16.598317 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4609320-b8b7-4c91-8a17-c0e76b84ed21 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:16.653547 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9996e66-7fc5-434d-ba25-35b384ab8cc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:16.655663 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9996e66-7fc5-434d-ba25-35b384ab8cc4 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:16.688862 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1289b6-bb6c-4703-a4ce-8afef2e00edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:16.689544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1289b6-bb6c-4703-a4ce-8afef2e00edc None admin] REQUEST_METHOD: `PUT` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:16.689826 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1289b6-bb6c-4703-a4ce-8afef2e00edc None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:16.690103 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1289b6-bb6c-4703-a4ce-8afef2e00edc None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c/users/a22a920d57654d83a1bf41be5bef2adc/roles/4bc1625db2f14e779d8acb4d21d9d3f1` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:16.692092 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1289b6-bb6c-4703-a4ce-8afef2e00edc None admin] RBAC: Authorizing `identity:create_grant(project_id=40b3e0cdb32043e499f5197ea0bfea1c, user_id=a22a920d57654d83a1bf41be5bef2adc, role_id=4bc1625db2f14e779d8acb4d21d9d3f1)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:16.693543 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1289b6-bb6c-4703-a4ce-8afef2e00edc None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:16.742608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:16.765190 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 138/260] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:25:16.770984 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9996e66-7fc5-434d-ba25-35b384ab8cc4 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:16.780094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 123/261] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:25:16 2022] PUT /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c/users/a22a920d57654d83a1bf41be5bef2adc/roles/4bc1625db2f14e779d8acb4d21d9d3f1 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:25:16.884641 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9996e66-7fc5-434d-ba25-35b384ab8cc4 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:16.946608 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1289b6-bb6c-4703-a4ce-8afef2e00edc None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:16.948083 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471205d-f11c-4be2-bb44-dd57a82fe5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:16.949034 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471205d-f11c-4be2-bb44-dd57a82fe5e3 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:16.949427 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471205d-f11c-4be2-bb44-dd57a82fe5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:16.949847 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471205d-f11c-4be2-bb44-dd57a82fe5e3 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:16.950906 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471205d-f11c-4be2-bb44-dd57a82fe5e3 None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:16.953012 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471205d-f11c-4be2-bb44-dd57a82fe5e3 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:16.955124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 139/262] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:16 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:16.961073 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471205d-f11c-4be2-bb44-dd57a82fe5e3 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:17.031596 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:17.145666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471205d-f11c-4be2-bb44-dd57a82fe5e3 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:17.163891 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1289b6-bb6c-4703-a4ce-8afef2e00edc None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:17.225527 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ce3bd-d1e6-4ec3-b0d3-6b8f3aeae458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:17.226197 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ce3bd-d1e6-4ec3-b0d3-6b8f3aeae458 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:17.226517 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ce3bd-d1e6-4ec3-b0d3-6b8f3aeae458 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:17.226793 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ce3bd-d1e6-4ec3-b0d3-6b8f3aeae458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:17.230784 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ce3bd-d1e6-4ec3-b0d3-6b8f3aeae458 None admin] RBAC: Adding query filter params (role.id=091802a86e334e129210219b7c69359d, scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c, user.id=c758fcbb9efa4fe1a05bf329f726ca3c) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:17.232507 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ce3bd-d1e6-4ec3-b0d3-6b8f3aeae458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:17.233063 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:17.236039 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ce3bd-d1e6-4ec3-b0d3-6b8f3aeae458 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:17.245751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95897a5e-8116-469c-9481-a1f5e5ffb724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:17.246407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95897a5e-8116-469c-9481-a1f5e5ffb724 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:17.246689 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95897a5e-8116-469c-9481-a1f5e5ffb724 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:17.248091 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95897a5e-8116-469c-9481-a1f5e5ffb724 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:17.256728 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 140/263] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:16 2022] GET /identity/v3/role_assignments?user.id=c758fcbb9efa4fe1a05bf329f726ca3c&scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c&role.id=091802a86e334e129210219b7c69359d => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:17.269467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95897a5e-8116-469c-9481-a1f5e5ffb724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-95897a5e-8116-469c-9481-a1f5e5ffb724 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:17.280795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:17.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:17.289685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:17.289685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:17.289685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:17.289685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:17.289685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:17.289685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:17.289685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:17.289685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:17.289685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:17.289685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:17.289685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:17.289685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:17.289685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 124/264] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:25:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:17.290514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ce3bd-d1e6-4ec3-b0d3-6b8f3aeae458 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:17.464119 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ce3bd-d1e6-4ec3-b0d3-6b8f3aeae458 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:17.485594 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:17.516430 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610e6bf-692b-4ea0-8b35-6b6b14ef9419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:17.517354 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610e6bf-692b-4ea0-8b35-6b6b14ef9419 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:17.521980 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610e6bf-692b-4ea0-8b35-6b6b14ef9419 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:17.522256 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610e6bf-692b-4ea0-8b35-6b6b14ef9419 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:17.522958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610e6bf-692b-4ea0-8b35-6b6b14ef9419 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:17.523299 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610e6bf-692b-4ea0-8b35-6b6b14ef9419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:17.524938 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610e6bf-692b-4ea0-8b35-6b6b14ef9419 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:17.534624 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 141/265] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:17.540197 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95897a5e-8116-469c-9481-a1f5e5ffb724 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:17.685589 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95897a5e-8116-469c-9481-a1f5e5ffb724 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:17.728750 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff55a0-ea3a-44a9-af13-65c7b8399963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:17.729853 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff55a0-ea3a-44a9-af13-65c7b8399963 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:17.730339 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff55a0-ea3a-44a9-af13-65c7b8399963 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:17.730812 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff55a0-ea3a-44a9-af13-65c7b8399963 None admin] PATH_INFO: `/v3/users/c758fcbb9efa4fe1a05bf329f726ca3c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:17.732233 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff55a0-ea3a-44a9-af13-65c7b8399963 None admin] RBAC: Authorizing `identity:get_user(user_id=c758fcbb9efa4fe1a05bf329f726ca3c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:17.734573 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff55a0-ea3a-44a9-af13-65c7b8399963 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:17.736891 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 125/266] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:17 2022] GET /identity/v3/users/c758fcbb9efa4fe1a05bf329f726ca3c => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:17.742140 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610e6bf-692b-4ea0-8b35-6b6b14ef9419 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:17.867993 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610e6bf-692b-4ea0-8b35-6b6b14ef9419 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:17.915899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95312f-6b10-42fb-88d5-4ff263d43cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:17.916527 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95312f-6b10-42fb-88d5-4ff263d43cee None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:17.916803 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95312f-6b10-42fb-88d5-4ff263d43cee None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:17.917074 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95312f-6b10-42fb-88d5-4ff263d43cee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:17.975662 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:18.017966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95312f-6b10-42fb-88d5-4ff263d43cee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:18.019481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95312f-6b10-42fb-88d5-4ff263d43cee None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:18.161277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eccb30-bd21-4641-bbcc-f019ca808ad8 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:18.161972 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eccb30-bd21-4641-bbcc-f019ca808ad8 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:18.161972 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eccb30-bd21-4641-bbcc-f019ca808ad8 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:18.162387 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 142/267] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:18.163352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 126/268] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:18.169927 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95312f-6b10-42fb-88d5-4ff263d43cee None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:18.175717 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1feeb-f013-4cfb-bf4f-e60af03d1374 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:18.176031 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1feeb-f013-4cfb-bf4f-e60af03d1374 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:18.176274 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1feeb-f013-4cfb-bf4f-e60af03d1374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:18.220163 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-e4e1feeb-f013-4cfb-bf4f-e60af03d1374 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:18.221401 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-e4e1feeb-f013-4cfb-bf4f-e60af03d1374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:18.264425 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:18.306171 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95312f-6b10-42fb-88d5-4ff263d43cee None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:18.319242 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:18.335720 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 127/269] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:18.382498 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1e2d8-b60c-4b07-a932-979f8d67eb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:18.383189 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1e2d8-b60c-4b07-a932-979f8d67eb1d None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:18.383496 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1e2d8-b60c-4b07-a932-979f8d67eb1d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:18.383772 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1e2d8-b60c-4b07-a932-979f8d67eb1d None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:18.385871 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1e2d8-b60c-4b07-a932-979f8d67eb1d None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:18.387385 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1e2d8-b60c-4b07-a932-979f8d67eb1d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:18.389845 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 143/270] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:18 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:18.395817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1feeb-f013-4cfb-bf4f-e60af03d1374 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:18.464446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88d19a-672f-4a5e-a9c2-b92b17300bcb None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:18.464738 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88d19a-672f-4a5e-a9c2-b92b17300bcb None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:18.465109 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88d19a-672f-4a5e-a9c2-b92b17300bcb None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:18.467427 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 144/271] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:18.473538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61956344-d433-4330-8be7-2307be97d038 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:18.473892 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61956344-d433-4330-8be7-2307be97d038 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:18.474247 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61956344-d433-4330-8be7-2307be97d038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:18.494494 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-61956344-d433-4330-8be7-2307be97d038 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:18.495868 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-61956344-d433-4330-8be7-2307be97d038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:18.526728 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1feeb-f013-4cfb-bf4f-e60af03d1374 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:18.565083 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d708f-eadb-4e6e-914c-aa65e614524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:18.566088 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d708f-eadb-4e6e-914c-aa65e614524f None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:18.566537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d708f-eadb-4e6e-914c-aa65e614524f None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:18.567009 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d708f-eadb-4e6e-914c-aa65e614524f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:18.568104 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d708f-eadb-4e6e-914c-aa65e614524f None admin] RBAC: Adding query filter params (role.id=1f86135571074da38ac7d898436a8862, scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c, user.id=c758fcbb9efa4fe1a05bf329f726ca3c) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:18.568585 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d708f-eadb-4e6e-914c-aa65e614524f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:18.570415 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d708f-eadb-4e6e-914c-aa65e614524f None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:18.577084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 128/272] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:18 2022] GET /identity/v3/role_assignments?user.id=c758fcbb9efa4fe1a05bf329f726ca3c&scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c&role.id=1f86135571074da38ac7d898436a8862 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:18.635326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 145/273] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:18.667471 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7697af-afcf-44ef-9453-e288891f7e6b None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:18.668100 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7697af-afcf-44ef-9453-e288891f7e6b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:18.668575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7697af-afcf-44ef-9453-e288891f7e6b None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:18.670281 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 129/274] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:18.676749 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97b007-b312-4570-9a73-0c1272b49e8c None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:18.677362 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97b007-b312-4570-9a73-0c1272b49e8c None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:18.677831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97b007-b312-4570-9a73-0c1272b49e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:18.706137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-2e97b007-b312-4570-9a73-0c1272b49e8c None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:18.707691 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-2e97b007-b312-4570-9a73-0c1272b49e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:18.802145 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 146/275] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:18.853221 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7697af-afcf-44ef-9453-e288891f7e6b None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:18.931866 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:18.988569 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7697af-afcf-44ef-9453-e288891f7e6b None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:19.025741 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37881-ca00-484f-bbae-72a93f638aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:19.026399 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37881-ca00-484f-bbae-72a93f638aac None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:19.026674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37881-ca00-484f-bbae-72a93f638aac None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:19.026947 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37881-ca00-484f-bbae-72a93f638aac None admin] PATH_INFO: `/v3/domains/default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:19.028182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37881-ca00-484f-bbae-72a93f638aac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:19.030346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37881-ca00-484f-bbae-72a93f638aac None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:19.032091 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 130/276] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:19.038014 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97b007-b312-4570-9a73-0c1272b49e8c None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:19.043634 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:19.099524 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37881-ca00-484f-bbae-72a93f638aac None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:19.175845 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97b007-b312-4570-9a73-0c1272b49e8c None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:19.230797 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76131d-62f2-4ddb-a66a-be0a5bae6349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:19.231834 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76131d-62f2-4ddb-a66a-be0a5bae6349 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:19.232274 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37881-ca00-484f-bbae-72a93f638aac None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:19.233011 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76131d-62f2-4ddb-a66a-be0a5bae6349 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:19.233487 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76131d-62f2-4ddb-a66a-be0a5bae6349 None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:19.235610 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76131d-62f2-4ddb-a66a-be0a5bae6349 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:19.237714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76131d-62f2-4ddb-a66a-be0a5bae6349 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:19.266096 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:19.281110 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32a2d9-e5aa-4bb2-8034-c7479c93fcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:19.282628 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32a2d9-e5aa-4bb2-8034-c7479c93fcee None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:19.282628 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32a2d9-e5aa-4bb2-8034-c7479c93fcee None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:19.282628 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32a2d9-e5aa-4bb2-8034-c7479c93fcee None admin] PATH_INFO: `/v3/roles/member` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:19.293351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32a2d9-e5aa-4bb2-8034-c7479c93fcee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-ab32a2d9-e5aa-4bb2-8034-c7479c93fcee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:19.298112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:19.299141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 131/277] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:25:19.301464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32a2d9-e5aa-4bb2-8034-c7479c93fcee None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:19.346378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 147/278] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Aug 23 16:25:19 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:25:19.356432 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76131d-62f2-4ddb-a66a-be0a5bae6349 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:19.420559 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32a2d9-e5aa-4bb2-8034-c7479c93fcee None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:19.439342 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:19.464423 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bb952-d304-4526-80e6-c6f60ebc03c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:19.465003 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb952-d304-4526-80e6-c6f60ebc03c8 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:19.465249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb952-d304-4526-80e6-c6f60ebc03c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:19.465523 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb952-d304-4526-80e6-c6f60ebc03c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:19.478375 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bb952-d304-4526-80e6-c6f60ebc03c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-e64bb952-d304-4526-80e6-c6f60ebc03c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:19.487555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:19.488548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:19.489431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:19.489431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:19.489431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:19.489431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:19.489431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:19.489431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:19.489431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:19.489431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:19.489431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:19.489431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:19.489431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:19.489431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:19.493547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 132/279] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:19.495756 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bb952-d304-4526-80e6-c6f60ebc03c8 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:19.496552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76131d-62f2-4ddb-a66a-be0a5bae6349 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:19.538271 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89701cca-283f-4791-9a2c-cf7bc9df79ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:19.539279 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89701cca-283f-4791-9a2c-cf7bc9df79ba None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:19.539777 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89701cca-283f-4791-9a2c-cf7bc9df79ba None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:19.540115 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89701cca-283f-4791-9a2c-cf7bc9df79ba None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:19.540866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89701cca-283f-4791-9a2c-cf7bc9df79ba None admin] RBAC: Adding query filter params (name=member) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:19.541260 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89701cca-283f-4791-9a2c-cf7bc9df79ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:19.542724 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89701cca-283f-4791-9a2c-cf7bc9df79ba None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:19.552451 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 148/280] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:19.558196 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89701cca-283f-4791-9a2c-cf7bc9df79ba None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:19.575463 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:19.656788 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bb952-d304-4526-80e6-c6f60ebc03c8 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:19.681006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89701cca-283f-4791-9a2c-cf7bc9df79ba None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:19.699995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72a04d-6340-43d2-bc7e-c2f7d952abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:19.700621 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a04d-6340-43d2-bc7e-c2f7d952abd4 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:19.700902 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a04d-6340-43d2-bc7e-c2f7d952abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:19.701206 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a04d-6340-43d2-bc7e-c2f7d952abd4 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:19.701879 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72a04d-6340-43d2-bc7e-c2f7d952abd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:19.702182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72a04d-6340-43d2-bc7e-c2f7d952abd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:19.703598 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72a04d-6340-43d2-bc7e-c2f7d952abd4 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:19.710113 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:19.714338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 133/281] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:19.715706 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639f99-cd07-45df-b5fd-ddb09c0fc334 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:19.715992 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639f99-cd07-45df-b5fd-ddb09c0fc334 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:19.716269 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639f99-cd07-45df-b5fd-ddb09c0fc334 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:19.718042 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 134/282] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:19.720413 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25639f99-cd07-45df-b5fd-ddb09c0fc334 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:19.730244 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8614cba-d773-4096-869d-ccc0bab8ba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:19.731018 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8614cba-d773-4096-869d-ccc0bab8ba85 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:19.731390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8614cba-d773-4096-869d-ccc0bab8ba85 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:19.731731 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8614cba-d773-4096-869d-ccc0bab8ba85 None admin] PATH_INFO: `/v3/users/69d1a1b198f54f55989efacae84d3488` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:19.751093 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8614cba-d773-4096-869d-ccc0bab8ba85 None admin] RBAC: Authorizing `identity:get_user(user_id=69d1a1b198f54f55989efacae84d3488)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:19.752497 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8614cba-d773-4096-869d-ccc0bab8ba85 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:19.754238 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 149/283] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:19 2022] GET /identity/v3/users/69d1a1b198f54f55989efacae84d3488 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:19.755328 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcd40d-5704-4c6c-9d22-b71b9c8d8bd7 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:19.759288 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcd40d-5704-4c6c-9d22-b71b9c8d8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:19.759288 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcd40d-5704-4c6c-9d22-b71b9c8d8bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:19.776345 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-cbfcd40d-5704-4c6c-9d22-b71b9c8d8bd7 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:19.777116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-cbfcd40d-5704-4c6c-9d22-b71b9c8d8bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:19.852779 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 150/284] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:19.855055 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcd40d-5704-4c6c-9d22-b71b9c8d8bd7 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:19.872377 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25639f99-cd07-45df-b5fd-ddb09c0fc334 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:19.874582 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:19.936347 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0429d7-ba1e-453d-8e3c-e3e43924a6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:19.936973 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0429d7-ba1e-453d-8e3c-e3e43924a6b5 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:19.937249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0429d7-ba1e-453d-8e3c-e3e43924a6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:19.937523 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0429d7-ba1e-453d-8e3c-e3e43924a6b5 None admin] PATH_INFO: `/v3/users/483f52386e684f6ca605bcce5c122389` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:19.938831 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0429d7-ba1e-453d-8e3c-e3e43924a6b5 None admin] RBAC: Authorizing `identity:get_user(user_id=483f52386e684f6ca605bcce5c122389)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:19.940308 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0429d7-ba1e-453d-8e3c-e3e43924a6b5 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:19.941902 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 135/285] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:19 2022] GET /identity/v3/users/483f52386e684f6ca605bcce5c122389 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:19.947830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0429d7-ba1e-453d-8e3c-e3e43924a6b5 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:20.056964 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcd40d-5704-4c6c-9d22-b71b9c8d8bd7 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:20.067049 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:20.093573 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fb763-0bda-4c2f-bdf5-617e58c8df9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:20.094114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fb763-0bda-4c2f-bdf5-617e58c8df9b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:20.094387 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fb763-0bda-4c2f-bdf5-617e58c8df9b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:20.094706 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fb763-0bda-4c2f-bdf5-617e58c8df9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:20.095507 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fb763-0bda-4c2f-bdf5-617e58c8df9b None admin] RBAC: Adding query filter params (role.id=4bc1625db2f14e779d8acb4d21d9d3f1, user.id=69d1a1b198f54f55989efacae84d3488, scope.system=all) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:20.095818 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fb763-0bda-4c2f-bdf5-617e58c8df9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:20.097256 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fb763-0bda-4c2f-bdf5-617e58c8df9b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:20.104189 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 151/286] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Aug 23 16:25:19 2022] GET /identity/v3/role_assignments?user.id=69d1a1b198f54f55989efacae84d3488&scope.system=all&role.id=4bc1625db2f14e779d8acb4d21d9d3f1 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:20.120744 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0429d7-ba1e-453d-8e3c-e3e43924a6b5 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:20.170377 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf197b-9063-446e-bd35-866a3eac8702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:20.171044 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf197b-9063-446e-bd35-866a3eac8702 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:20.171347 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf197b-9063-446e-bd35-866a3eac8702 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:20.171623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf197b-9063-446e-bd35-866a3eac8702 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:20.172874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf197b-9063-446e-bd35-866a3eac8702 None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:20.174392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf197b-9063-446e-bd35-866a3eac8702 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:20.176341 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 136/287] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:19 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:20.182415 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fb763-0bda-4c2f-bdf5-617e58c8df9b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:20.316984 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fb763-0bda-4c2f-bdf5-617e58c8df9b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:20.336313 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf197b-9063-446e-bd35-866a3eac8702 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:20.365836 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80aa4-fa1b-4942-a2fc-c8ac3fef0ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:20.366446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80aa4-fa1b-4942-a2fc-c8ac3fef0ae8 None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:20.366616 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80aa4-fa1b-4942-a2fc-c8ac3fef0ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:20.366892 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80aa4-fa1b-4942-a2fc-c8ac3fef0ae8 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c/users/483f52386e684f6ca605bcce5c122389/roles/225f2a2bd302418485ac34ecb871c3e4` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:20.371149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80aa4-fa1b-4942-a2fc-c8ac3fef0ae8 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b3e0cdb32043e499f5197ea0bfea1c, user_id=483f52386e684f6ca605bcce5c122389, role_id=225f2a2bd302418485ac34ecb871c3e4)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:20.374735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80aa4-fa1b-4942-a2fc-c8ac3fef0ae8 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:20.407616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:20.457305 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 152/288] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:25:20 2022] PUT /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c/users/483f52386e684f6ca605bcce5c122389/roles/225f2a2bd302418485ac34ecb871c3e4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:25:20.473926 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf197b-9063-446e-bd35-866a3eac8702 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:20.536173 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae9cfa-74dd-4d2f-a8b5-e74b5bd8c419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:20.537250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae9cfa-74dd-4d2f-a8b5-e74b5bd8c419 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:20.537727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae9cfa-74dd-4d2f-a8b5-e74b5bd8c419 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:20.538194 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae9cfa-74dd-4d2f-a8b5-e74b5bd8c419 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:20.557575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae9cfa-74dd-4d2f-a8b5-e74b5bd8c419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-c5ae9cfa-74dd-4d2f-a8b5-e74b5bd8c419 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:20.567575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:20.568551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:20.569344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:20.569344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:20.569344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:20.569344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:20.569344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:20.569344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:20.569344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:20.569344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:20.569344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:20.569344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:20.569344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:20.569344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:20.571896 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 137/289] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:20.578817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80aa4-fa1b-4942-a2fc-c8ac3fef0ae8 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:20.631624 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:20.745327 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80aa4-fa1b-4942-a2fc-c8ac3fef0ae8 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:20.788833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156d6b1-5289-4ffc-9f49-8ced61504a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:20.789444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156d6b1-5289-4ffc-9f49-8ced61504a41 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:20.789781 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156d6b1-5289-4ffc-9f49-8ced61504a41 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:20.790054 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156d6b1-5289-4ffc-9f49-8ced61504a41 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:20.790705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156d6b1-5289-4ffc-9f49-8ced61504a41 None admin] RBAC: Adding query filter params (name=member) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:20.791050 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156d6b1-5289-4ffc-9f49-8ced61504a41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:20.792452 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156d6b1-5289-4ffc-9f49-8ced61504a41 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:20.803324 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 153/290] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:20.811845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae9cfa-74dd-4d2f-a8b5-e74b5bd8c419 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:20.927967 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:20.931928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae9cfa-74dd-4d2f-a8b5-e74b5bd8c419 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:20.968887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b93d4-f20e-4a22-b76b-207c3a46da54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:20.969569 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b93d4-f20e-4a22-b76b-207c3a46da54 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:20.970058 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b93d4-f20e-4a22-b76b-207c3a46da54 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:20.970529 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b93d4-f20e-4a22-b76b-207c3a46da54 None admin] PATH_INFO: `/v3/users/a22a920d57654d83a1bf41be5bef2adc` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:20.972039 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b93d4-f20e-4a22-b76b-207c3a46da54 None admin] RBAC: Authorizing `identity:get_user(user_id=a22a920d57654d83a1bf41be5bef2adc)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:20.973573 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b93d4-f20e-4a22-b76b-207c3a46da54 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:20.975661 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 138/291] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:20 2022] GET /identity/v3/users/a22a920d57654d83a1bf41be5bef2adc => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:20.982012 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156d6b1-5289-4ffc-9f49-8ced61504a41 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:21.133645 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:21.141435 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156d6b1-5289-4ffc-9f49-8ced61504a41 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:21.186627 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7166e8-34ce-4d2f-8b8e-85af31fb9caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:21.187248 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7166e8-34ce-4d2f-8b8e-85af31fb9caa None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:21.187478 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7166e8-34ce-4d2f-8b8e-85af31fb9caa None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:21.187758 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7166e8-34ce-4d2f-8b8e-85af31fb9caa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:21.270711 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7166e8-34ce-4d2f-8b8e-85af31fb9caa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:21.272195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7166e8-34ce-4d2f-8b8e-85af31fb9caa None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:21.386269 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:21.394958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 154/292] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:21.401142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b93d4-f20e-4a22-b76b-207c3a46da54 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:21.555259 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b93d4-f20e-4a22-b76b-207c3a46da54 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:21.837544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9922e65-3f22-4a68-af24-cfcf8a7859c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:21.837544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9922e65-3f22-4a68-af24-cfcf8a7859c7 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:21.837544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9922e65-3f22-4a68-af24-cfcf8a7859c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:21.837544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9922e65-3f22-4a68-af24-cfcf8a7859c7 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:21.838419 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9922e65-3f22-4a68-af24-cfcf8a7859c7 None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:21.838419 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9922e65-3f22-4a68-af24-cfcf8a7859c7 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:21.838419 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 139/293] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:21 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:21.838612 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7166e8-34ce-4d2f-8b8e-85af31fb9caa None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:21.838612 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7166e8-34ce-4d2f-8b8e-85af31fb9caa None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:21.838612 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9f219-811e-4c72-b70c-d67254debc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:21.838612 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9f219-811e-4c72-b70c-d67254debc3c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:21.838889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9f219-811e-4c72-b70c-d67254debc3c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:21.838889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9f219-811e-4c72-b70c-d67254debc3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:21.838889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9f219-811e-4c72-b70c-d67254debc3c None admin] RBAC: Adding query filter params (role.id=4bc1625db2f14e779d8acb4d21d9d3f1, scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c, user.id=a22a920d57654d83a1bf41be5bef2adc) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:21.838889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9f219-811e-4c72-b70c-d67254debc3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:21.838889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9f219-811e-4c72-b70c-d67254debc3c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:21.839195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 155/294] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:21 2022] GET /identity/v3/role_assignments?user.id=a22a920d57654d83a1bf41be5bef2adc&scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c&role.id=4bc1625db2f14e779d8acb4d21d9d3f1 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:22.228455 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686d43-e904-4730-9b62-52eebe57d408 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:22.228642 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686d43-e904-4730-9b62-52eebe57d408 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:22.228920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686d43-e904-4730-9b62-52eebe57d408 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:22.230613 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 140/295] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:22.238160 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2b7dc-bd9b-4ff1-998e-7983b1213d3c None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:22.238800 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2b7dc-bd9b-4ff1-998e-7983b1213d3c None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:22.238800 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2b7dc-bd9b-4ff1-998e-7983b1213d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:22.243705 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b391e1-1115-4526-87c1-0178148ef8bf None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:22.243705 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b391e1-1115-4526-87c1-0178148ef8bf None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:22.243705 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b391e1-1115-4526-87c1-0178148ef8bf None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:22.243705 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 141/296] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:25:22.250864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab27c8-9d09-45a6-8feb-da5853f8c2f6 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:22.250864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab27c8-9d09-45a6-8feb-da5853f8c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:22.250864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab27c8-9d09-45a6-8feb-da5853f8c2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:22.262367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-94b2b7dc-bd9b-4ff1-998e-7983b1213d3c None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:22.263700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-94b2b7dc-bd9b-4ff1-998e-7983b1213d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:22.271555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-85ab27c8-9d09-45a6-8feb-da5853f8c2f6 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:22.273040 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-85ab27c8-9d09-45a6-8feb-da5853f8c2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:22.311584 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:22.334077 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:22.351762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 156/297] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:22.372408 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 142/298] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:22.659070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ab988-8db1-479f-8d60-7d9e8dd6ee97 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:22.659549 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ab988-8db1-479f-8d60-7d9e8dd6ee97 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:22.659821 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ab988-8db1-479f-8d60-7d9e8dd6ee97 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:22.661431 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 157/299] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:22.666976 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418a5ac-0532-411c-85cd-6efd2842bd9c None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:22.667879 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418a5ac-0532-411c-85cd-6efd2842bd9c None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:22.668359 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418a5ac-0532-411c-85cd-6efd2842bd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:22.686410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-5418a5ac-0532-411c-85cd-6efd2842bd9c None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:22.687936 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-5418a5ac-0532-411c-85cd-6efd2842bd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:22.694731 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ab988-8db1-479f-8d60-7d9e8dd6ee97 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:22.776506 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 143/300] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:22.777474 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418a5ac-0532-411c-85cd-6efd2842bd9c None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:22.806442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ab988-8db1-479f-8d60-7d9e8dd6ee97 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:22.844336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9646b2-0421-40e8-a56d-b59fd15ff5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:22.845235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9646b2-0421-40e8-a56d-b59fd15ff5ce None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:22.845728 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9646b2-0421-40e8-a56d-b59fd15ff5ce None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:22.846141 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9646b2-0421-40e8-a56d-b59fd15ff5ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:22.847454 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9646b2-0421-40e8-a56d-b59fd15ff5ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:22.849238 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9646b2-0421-40e8-a56d-b59fd15ff5ce None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:22.850969 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 158/301] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:22.856850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9646b2-0421-40e8-a56d-b59fd15ff5ce None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:22.887537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:22.894773 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418a5ac-0532-411c-85cd-6efd2842bd9c None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:22.919802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:22.930552 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c9384-7120-4d84-a4b2-789bc80074fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:22.931258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c9384-7120-4d84-a4b2-789bc80074fc None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:22.931551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c9384-7120-4d84-a4b2-789bc80074fc None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:22.931803 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c9384-7120-4d84-a4b2-789bc80074fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:22.944528 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c9384-7120-4d84-a4b2-789bc80074fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-898c9384-7120-4d84-a4b2-789bc80074fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:22.950850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:22.952501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:22.953319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:22.953319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:22.953319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:22.953319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:22.953319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:22.953319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:22.953319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:22.953319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:22.953319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:22.953319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:22.953319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:22.953319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:22.953319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 144/302] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:22.966729 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9646b2-0421-40e8-a56d-b59fd15ff5ce None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:22.968498 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c9384-7120-4d84-a4b2-789bc80074fc None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:23.007078 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6cfcd-0f4a-45aa-8e1c-472f9f30a898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:23.007977 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6cfcd-0f4a-45aa-8e1c-472f9f30a898 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:23.008466 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6cfcd-0f4a-45aa-8e1c-472f9f30a898 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:23.008883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6cfcd-0f4a-45aa-8e1c-472f9f30a898 None admin] PATH_INFO: `/v3/groups` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:23.009780 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6cfcd-0f4a-45aa-8e1c-472f9f30a898 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:23.011429 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6cfcd-0f4a-45aa-8e1c-472f9f30a898 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:23.079371 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 159/303] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Aug 23 16:25:22 2022] POST /identity/v3/groups => generated 229 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:25:23.094981 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c9384-7120-4d84-a4b2-789bc80074fc None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:23.136326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6cfcd-0f4a-45aa-8e1c-472f9f30a898 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:23.137646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c8d29-fc22-4e00-aebc-43c372bd110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:23.138279 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8d29-fc22-4e00-aebc-43c372bd110d None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:23.138616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8d29-fc22-4e00-aebc-43c372bd110d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:23.138891 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8d29-fc22-4e00-aebc-43c372bd110d None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:23.139611 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c8d29-fc22-4e00-aebc-43c372bd110d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:23.139919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c8d29-fc22-4e00-aebc-43c372bd110d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:23.141573 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c8d29-fc22-4e00-aebc-43c372bd110d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:23.155313 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 145/304] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:23.158187 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c8d29-fc22-4e00-aebc-43c372bd110d None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:23.180985 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:23.268258 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6cfcd-0f4a-45aa-8e1c-472f9f30a898 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:23.278597 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c8d29-fc22-4e00-aebc-43c372bd110d None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:23.287244 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:23.312138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649278a8-0478-468c-bcc3-ed26499f4207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:23.312728 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649278a8-0478-468c-bcc3-ed26499f4207 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:23.313005 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649278a8-0478-468c-bcc3-ed26499f4207 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:23.313277 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649278a8-0478-468c-bcc3-ed26499f4207 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:23.331879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649278a8-0478-468c-bcc3-ed26499f4207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:23.332352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bbb0c-a2d6-4ad7-9db5-6a77eb0718ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:23.333005 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bbb0c-a2d6-4ad7-9db5-6a77eb0718ee None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:23.333280 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bbb0c-a2d6-4ad7-9db5-6a77eb0718ee None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:23.333552 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bbb0c-a2d6-4ad7-9db5-6a77eb0718ee None admin] PATH_INFO: `/v3/users/610ed2521b9d4bfe8e704204dac2fc51` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-649278a8-0478-468c-bcc3-ed26499f4207 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:23.339705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:23.340743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:23.341552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:23.341552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:23.341552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:23.341552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:23.341552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:23.341552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:23.341552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:23.341552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:23.341552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:23.341552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:23.341552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:23.341552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:23.341552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 160/305] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:23.347115 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649278a8-0478-468c-bcc3-ed26499f4207 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:23.353562 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bbb0c-a2d6-4ad7-9db5-6a77eb0718ee None admin] RBAC: Authorizing `identity:get_user(user_id=610ed2521b9d4bfe8e704204dac2fc51)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:23.355087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bbb0c-a2d6-4ad7-9db5-6a77eb0718ee None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:23.358094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 146/306] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:23 2022] GET /identity/v3/users/610ed2521b9d4bfe8e704204dac2fc51 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:23.366080 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bbb0c-a2d6-4ad7-9db5-6a77eb0718ee None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:23.476794 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:23.492235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649278a8-0478-468c-bcc3-ed26499f4207 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:23.512747 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bbb0c-a2d6-4ad7-9db5-6a77eb0718ee None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:23.532607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b758f4b-d0f7-4831-b891-4a826d617f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:23.533206 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b758f4b-d0f7-4831-b891-4a826d617f52 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:23.533477 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b758f4b-d0f7-4831-b891-4a826d617f52 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:23.533747 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b758f4b-d0f7-4831-b891-4a826d617f52 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:23.534402 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b758f4b-d0f7-4831-b891-4a826d617f52 None admin] RBAC: Adding query filter params (name=member) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:23.534700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b758f4b-d0f7-4831-b891-4a826d617f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:23.536476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b758f4b-d0f7-4831-b891-4a826d617f52 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:23.545557 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 161/307] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:23.546543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385a5f-cefb-458d-9b3d-0b686962066a None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:23.546995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385a5f-cefb-458d-9b3d-0b686962066a None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:23.547112 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385a5f-cefb-458d-9b3d-0b686962066a None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:23.548496 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 162/308] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:23.551870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a61571-a45a-4657-97ce-2ecab0ef7396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:23.552561 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a61571-a45a-4657-97ce-2ecab0ef7396 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:23.552844 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a61571-a45a-4657-97ce-2ecab0ef7396 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:23.553118 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a61571-a45a-4657-97ce-2ecab0ef7396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:23.553220 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385a5f-cefb-458d-9b3d-0b686962066a None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:23.553892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a61571-a45a-4657-97ce-2ecab0ef7396 None admin] RBAC: Adding query filter params (role.id=225f2a2bd302418485ac34ecb871c3e4, user.id=610ed2521b9d4bfe8e704204dac2fc51, scope.system=all) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:23.554146 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a61571-a45a-4657-97ce-2ecab0ef7396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:23.555601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a61571-a45a-4657-97ce-2ecab0ef7396 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:23.561629 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 147/309] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Aug 23 16:25:23 2022] GET /identity/v3/role_assignments?user.id=610ed2521b9d4bfe8e704204dac2fc51&scope.system=all&role.id=225f2a2bd302418485ac34ecb871c3e4 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:23.562825 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a51d3-236d-411f-8afe-a01dd5d63798 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:23.563114 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a51d3-236d-411f-8afe-a01dd5d63798 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:23.563420 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a51d3-236d-411f-8afe-a01dd5d63798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:23.584034 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-d49a51d3-236d-411f-8afe-a01dd5d63798 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:23.585303 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-d49a51d3-236d-411f-8afe-a01dd5d63798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:23.620590 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:23.682514 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 148/310] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:23.696419 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385a5f-cefb-458d-9b3d-0b686962066a None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:23.737430 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f5b32-8c08-4121-9846-927819a062ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:23.737984 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f5b32-8c08-4121-9846-927819a062ae None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:23.738258 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f5b32-8c08-4121-9846-927819a062ae None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:23.738586 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f5b32-8c08-4121-9846-927819a062ae None admin] PATH_INFO: `/v3/users/69d1a1b198f54f55989efacae84d3488` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:23.739855 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f5b32-8c08-4121-9846-927819a062ae None admin] RBAC: Authorizing `identity:get_user(user_id=69d1a1b198f54f55989efacae84d3488)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:23.741307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f5b32-8c08-4121-9846-927819a062ae None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:23.743198 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 163/311] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:23 2022] GET /identity/v3/users/69d1a1b198f54f55989efacae84d3488 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:23.750620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a51d3-236d-411f-8afe-a01dd5d63798 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:23.827679 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:23.861150 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a51d3-236d-411f-8afe-a01dd5d63798 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:23.898046 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d498545-e0a2-472e-86d5-a7c11f0cbef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:23.898708 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d498545-e0a2-472e-86d5-a7c11f0cbef3 None admin] REQUEST_METHOD: `PUT` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:23.899268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d498545-e0a2-472e-86d5-a7c11f0cbef3 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:23.899614 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d498545-e0a2-472e-86d5-a7c11f0cbef3 None admin] PATH_INFO: `/v3/system/users/69d1a1b198f54f55989efacae84d3488/roles/4bc1625db2f14e779d8acb4d21d9d3f1` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:23.901059 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d498545-e0a2-472e-86d5-a7c11f0cbef3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=69d1a1b198f54f55989efacae84d3488, role_id=4bc1625db2f14e779d8acb4d21d9d3f1)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:23.902501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d498545-e0a2-472e-86d5-a7c11f0cbef3 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:24.015830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 149/312] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Aug 23 16:25:23 2022] PUT /identity/v3/system/users/69d1a1b198f54f55989efacae84d3488/roles/4bc1625db2f14e779d8acb4d21d9d3f1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:25:24.036423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f5b32-8c08-4121-9846-927819a062ae None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:24.155268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f5b32-8c08-4121-9846-927819a062ae None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:24.163208 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:24.195351 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d8d66-4192-4881-b3f4-222ba4e00b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:24.196008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d8d66-4192-4881-b3f4-222ba4e00b0b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:24.196280 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d8d66-4192-4881-b3f4-222ba4e00b0b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:24.196548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d8d66-4192-4881-b3f4-222ba4e00b0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:24.209536 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d8d66-4192-4881-b3f4-222ba4e00b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-d49d8d66-4192-4881-b3f4-222ba4e00b0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:24.215008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:24.216062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:24.217442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:24.217442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:24.217442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:24.217442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:24.217442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:24.217442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:24.217442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:24.217442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:24.217442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:24.217442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:24.217442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:24.217442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:24.217442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 164/313] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:24.223643 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d498545-e0a2-472e-86d5-a7c11f0cbef3 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:24.340771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d498545-e0a2-472e-86d5-a7c11f0cbef3 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:24.373401 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:24.378856 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44691c41-af69-4ea8-8111-1b60e0b45e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:24.379502 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691c41-af69-4ea8-8111-1b60e0b45e1a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:24.379777 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691c41-af69-4ea8-8111-1b60e0b45e1a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:24.380042 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691c41-af69-4ea8-8111-1b60e0b45e1a None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:24.380706 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44691c41-af69-4ea8-8111-1b60e0b45e1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:24.381005 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44691c41-af69-4ea8-8111-1b60e0b45e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:24.382466 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44691c41-af69-4ea8-8111-1b60e0b45e1a None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:24.392106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 150/314] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:24.397790 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d8d66-4192-4881-b3f4-222ba4e00b0b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:24.507144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d8d66-4192-4881-b3f4-222ba4e00b0b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:24.543769 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f217d-3e6c-4de1-be23-c07e7b412518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:24.545341 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f217d-3e6c-4de1-be23-c07e7b412518 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:24.545837 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f217d-3e6c-4de1-be23-c07e7b412518 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:24.546325 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f217d-3e6c-4de1-be23-c07e7b412518 None admin] PATH_INFO: `/v3/users/483f52386e684f6ca605bcce5c122389` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:24.547694 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f217d-3e6c-4de1-be23-c07e7b412518 None admin] RBAC: Authorizing `identity:get_user(user_id=483f52386e684f6ca605bcce5c122389)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:24.549370 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f217d-3e6c-4de1-be23-c07e7b412518 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:24.551166 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 165/315] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:24 2022] GET /identity/v3/users/483f52386e684f6ca605bcce5c122389 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:24.556754 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44691c41-af69-4ea8-8111-1b60e0b45e1a None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:24.669280 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44691c41-af69-4ea8-8111-1b60e0b45e1a None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:24.709387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead394c9-3762-431c-9f55-5c2cb3d7de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:24.710039 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead394c9-3762-431c-9f55-5c2cb3d7de28 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:24.710323 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead394c9-3762-431c-9f55-5c2cb3d7de28 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:24.710600 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead394c9-3762-431c-9f55-5c2cb3d7de28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:24.778050 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:24.786896 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead394c9-3762-431c-9f55-5c2cb3d7de28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:24.788544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead394c9-3762-431c-9f55-5c2cb3d7de28 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:24.904921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 151/316] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:24.910690 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f217d-3e6c-4de1-be23-c07e7b412518 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:24.950667 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:25.030372 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f217d-3e6c-4de1-be23-c07e7b412518 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:25.069665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea8845-6798-4b4f-a544-aca992133949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:25.070670 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8845-6798-4b4f-a544-aca992133949 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:25.071173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8845-6798-4b4f-a544-aca992133949 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:25.071676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8845-6798-4b4f-a544-aca992133949 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:25.073046 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea8845-6798-4b4f-a544-aca992133949 None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:25.074824 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea8845-6798-4b4f-a544-aca992133949 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:25.077345 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 166/317] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:24 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:25.083458 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead394c9-3762-431c-9f55-5c2cb3d7de28 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:25.185863 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:25.192743 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead394c9-3762-431c-9f55-5c2cb3d7de28 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:25.231091 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dabc6f-a988-4d19-8566-a0783434081d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:25.231658 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dabc6f-a988-4d19-8566-a0783434081d None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:25.232346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dabc6f-a988-4d19-8566-a0783434081d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:25.232626 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dabc6f-a988-4d19-8566-a0783434081d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:25.233403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dabc6f-a988-4d19-8566-a0783434081d None admin] RBAC: Adding query filter params (role.id=225f2a2bd302418485ac34ecb871c3e4, scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c, user.id=483f52386e684f6ca605bcce5c122389) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:25.233925 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dabc6f-a988-4d19-8566-a0783434081d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:25.236047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dabc6f-a988-4d19-8566-a0783434081d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:25.247398 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 152/318] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:25 2022] GET /identity/v3/role_assignments?user.id=483f52386e684f6ca605bcce5c122389&scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c&role.id=225f2a2bd302418485ac34ecb871c3e4 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:25.514573 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ad84f-3410-472f-8e95-410d42564a7d None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:25.515050 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ad84f-3410-472f-8e95-410d42564a7d None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:25.515050 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ad84f-3410-472f-8e95-410d42564a7d None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:25.516562 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 167/319] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:25.522204 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ed9de-21e0-4cee-a1fd-a4b397701fe0 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:25.522491 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ed9de-21e0-4cee-a1fd-a4b397701fe0 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:25.522755 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ed9de-21e0-4cee-a1fd-a4b397701fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:25.544304 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-429ed9de-21e0-4cee-a1fd-a4b397701fe0 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:25.545858 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-429ed9de-21e0-4cee-a1fd-a4b397701fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:25.619126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 153/320] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:25.820576 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d7a3c-e830-450c-9167-d7b35b607cf5 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:25.820576 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d7a3c-e830-450c-9167-d7b35b607cf5 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:25.820853 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d7a3c-e830-450c-9167-d7b35b607cf5 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:25.822165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 168/321] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:25.828858 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd1aee-258d-47cc-b510-08affc335652 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:25.829641 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd1aee-258d-47cc-b510-08affc335652 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:25.829641 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd1aee-258d-47cc-b510-08affc335652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:25.847867 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-e1dd1aee-258d-47cc-b510-08affc335652 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:25.849087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-e1dd1aee-258d-47cc-b510-08affc335652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:25.931309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 154/322] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:25.943481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d7a3c-e830-450c-9167-d7b35b607cf5 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:26.069727 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d7a3c-e830-450c-9167-d7b35b607cf5 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:26.071323 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:26.104436 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f75145-eb66-4237-8867-411d20c41d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:26.105062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f75145-eb66-4237-8867-411d20c41d1f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:26.105360 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f75145-eb66-4237-8867-411d20c41d1f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:26.105608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f75145-eb66-4237-8867-411d20c41d1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:26.106702 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f75145-eb66-4237-8867-411d20c41d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:26.108692 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f75145-eb66-4237-8867-411d20c41d1f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:26.116249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 169/323] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:26.116404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd1aee-258d-47cc-b510-08affc335652 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:26.136053 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:26.220796 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd1aee-258d-47cc-b510-08affc335652 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:26.256982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bece9f2-1e57-4d49-8e30-9775424eacd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:26.257206 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f75145-eb66-4237-8867-411d20c41d1f None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:26.257590 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bece9f2-1e57-4d49-8e30-9775424eacd2 None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:26.257901 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bece9f2-1e57-4d49-8e30-9775424eacd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:26.258128 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bece9f2-1e57-4d49-8e30-9775424eacd2 None admin] PATH_INFO: `/v3/groups` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:26.258749 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bece9f2-1e57-4d49-8e30-9775424eacd2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:26.260428 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bece9f2-1e57-4d49-8e30-9775424eacd2 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:26.352907 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 155/324] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Aug 23 16:25:26 2022] POST /identity/v3/groups => generated 226 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:25:26.367876 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f75145-eb66-4237-8867-411d20c41d1f None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:26.373602 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62996528-9b22-4463-bde5-775b381d269d None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:26.373930 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62996528-9b22-4463-bde5-775b381d269d None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:26.374234 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62996528-9b22-4463-bde5-775b381d269d None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:26.375529 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 156/325] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:26.383414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c1d3f-71a2-4eb8-96b5-964faf8dc56b None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:26.383726 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c1d3f-71a2-4eb8-96b5-964faf8dc56b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:26.383974 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c1d3f-71a2-4eb8-96b5-964faf8dc56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:26.405008 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-bc5c1d3f-71a2-4eb8-96b5-964faf8dc56b None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:26.406324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-bc5c1d3f-71a2-4eb8-96b5-964faf8dc56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:26.409063 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5f00-1aa9-44ce-9885-049980b6b6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:26.409720 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5f00-1aa9-44ce-9885-049980b6b6ca None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:26.409997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5f00-1aa9-44ce-9885-049980b6b6ca None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:26.410270 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5f00-1aa9-44ce-9885-049980b6b6ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:26.423082 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d5f00-1aa9-44ce-9885-049980b6b6ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-6a6d5f00-1aa9-44ce-9885-049980b6b6ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:26.428303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:26.429470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:26.430697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:26.430697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:26.430697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:26.430697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:26.430697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:26.430697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:26.430697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:26.430697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:26.430697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:26.430697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:26.430697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:26.430697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:26.430697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 170/326] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:25:26.436614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5f00-1aa9-44ce-9885-049980b6b6ca None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:26.475022 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:26.492054 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 157/327] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:26.562334 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5f00-1aa9-44ce-9885-049980b6b6ca None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:26.597537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25a167-f9e5-41f7-9e63-37a8ed4df381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:26.598140 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25a167-f9e5-41f7-9e63-37a8ed4df381 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:26.598417 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25a167-f9e5-41f7-9e63-37a8ed4df381 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:26.598696 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25a167-f9e5-41f7-9e63-37a8ed4df381 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:26.599458 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25a167-f9e5-41f7-9e63-37a8ed4df381 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:26.599767 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25a167-f9e5-41f7-9e63-37a8ed4df381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:26.601131 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25a167-f9e5-41f7-9e63-37a8ed4df381 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:26.610874 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 171/328] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:26.616412 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c1d3f-71a2-4eb8-96b5-964faf8dc56b None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:26.627342 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:26.738382 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c1d3f-71a2-4eb8-96b5-964faf8dc56b None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:26.780011 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887af47-af15-473e-84d6-c0216430cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:26.780661 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887af47-af15-473e-84d6-c0216430cb31 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:26.780935 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887af47-af15-473e-84d6-c0216430cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:26.781203 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887af47-af15-473e-84d6-c0216430cb31 None admin] PATH_INFO: `/v3/users/610ed2521b9d4bfe8e704204dac2fc51` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:26.782340 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887af47-af15-473e-84d6-c0216430cb31 None admin] RBAC: Authorizing `identity:get_user(user_id=610ed2521b9d4bfe8e704204dac2fc51)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:26.783822 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887af47-af15-473e-84d6-c0216430cb31 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:26.785763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 158/329] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:26 2022] GET /identity/v3/users/610ed2521b9d4bfe8e704204dac2fc51 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:26.791463 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25a167-f9e5-41f7-9e63-37a8ed4df381 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:26.826910 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887af47-af15-473e-84d6-c0216430cb31 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:26.907626 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:26.917044 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25a167-f9e5-41f7-9e63-37a8ed4df381 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:26.934389 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:26.964461 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e5517-73f1-4e42-ac64-7b4d265c53d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:26.964940 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887af47-af15-473e-84d6-c0216430cb31 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:26.965144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e5517-73f1-4e42-ac64-7b4d265c53d1 None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:26.965432 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e5517-73f1-4e42-ac64-7b4d265c53d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:26.965809 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e5517-73f1-4e42-ac64-7b4d265c53d1 None admin] PATH_INFO: `/v3/system/users/610ed2521b9d4bfe8e704204dac2fc51/roles/225f2a2bd302418485ac34ecb871c3e4` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:26.967656 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e5517-73f1-4e42-ac64-7b4d265c53d1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=610ed2521b9d4bfe8e704204dac2fc51, role_id=225f2a2bd302418485ac34ecb871c3e4)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:26.969661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e5517-73f1-4e42-ac64-7b4d265c53d1 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:27.015720 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0ff98-4c20-4366-8d02-d169b1dc1d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:27.016428 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0ff98-4c20-4366-8d02-d169b1dc1d32 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:27.016708 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0ff98-4c20-4366-8d02-d169b1dc1d32 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:27.016980 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0ff98-4c20-4366-8d02-d169b1dc1d32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:27.030349 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0ff98-4c20-4366-8d02-d169b1dc1d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-b1d0ff98-4c20-4366-8d02-d169b1dc1d32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:27.035351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:27.036410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:27.037240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:27.037240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:27.037240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:27.037240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:27.037240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:27.037240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:27.037240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:27.037240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:27.037240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:27.037240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:27.037240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:27.037240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:27.037240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 159/330] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:25:27.047254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0ff98-4c20-4366-8d02-d169b1dc1d32 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:27.050964 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 172/331] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Aug 23 16:25:26 2022] PUT /identity/v3/system/users/610ed2521b9d4bfe8e704204dac2fc51/roles/225f2a2bd302418485ac34ecb871c3e4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:25:27.186259 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0ff98-4c20-4366-8d02-d169b1dc1d32 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:27.234576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92202928-8235-4cf1-804d-d746a4f24ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:27.235208 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92202928-8235-4cf1-804d-d746a4f24ef7 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:27.235565 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92202928-8235-4cf1-804d-d746a4f24ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:27.235848 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92202928-8235-4cf1-804d-d746a4f24ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:27.236532 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92202928-8235-4cf1-804d-d746a4f24ef7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:27.236837 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92202928-8235-4cf1-804d-d746a4f24ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:27.238374 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92202928-8235-4cf1-804d-d746a4f24ef7 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:27.242419 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:27.252328 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 160/332] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:27.258466 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e5517-73f1-4e42-ac64-7b4d265c53d1 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:27.380194 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e5517-73f1-4e42-ac64-7b4d265c53d1 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:27.419736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9048f5e-c07f-4358-b627-e448fc8f6614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:27.420459 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9048f5e-c07f-4358-b627-e448fc8f6614 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:27.420824 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9048f5e-c07f-4358-b627-e448fc8f6614 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:27.421082 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9048f5e-c07f-4358-b627-e448fc8f6614 None admin] PATH_INFO: `/v3/users/69d1a1b198f54f55989efacae84d3488` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:27.422291 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9048f5e-c07f-4358-b627-e448fc8f6614 None admin] RBAC: Authorizing `identity:get_user(user_id=69d1a1b198f54f55989efacae84d3488)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:27.423830 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9048f5e-c07f-4358-b627-e448fc8f6614 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:27.434531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 173/333] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:27 2022] GET /identity/v3/users/69d1a1b198f54f55989efacae84d3488 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:27.434652 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92202928-8235-4cf1-804d-d746a4f24ef7 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:27.553127 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92202928-8235-4cf1-804d-d746a4f24ef7 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:27.598845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461e5d1-5ce4-4009-a5bc-bdf1c14a1e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:27.599838 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461e5d1-5ce4-4009-a5bc-bdf1c14a1e41 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:27.600418 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461e5d1-5ce4-4009-a5bc-bdf1c14a1e41 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:27.600968 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461e5d1-5ce4-4009-a5bc-bdf1c14a1e41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:27.601997 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461e5d1-5ce4-4009-a5bc-bdf1c14a1e41 None admin] RBAC: Adding query filter params (role.id=4bc1625db2f14e779d8acb4d21d9d3f1, user.id=69d1a1b198f54f55989efacae84d3488, scope.system=all) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:27.602470 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461e5d1-5ce4-4009-a5bc-bdf1c14a1e41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:27.604121 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461e5d1-5ce4-4009-a5bc-bdf1c14a1e41 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:27.621333 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 161/334] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Aug 23 16:25:27 2022] GET /identity/v3/role_assignments?user.id=69d1a1b198f54f55989efacae84d3488&scope.system=all&role.id=4bc1625db2f14e779d8acb4d21d9d3f1 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:29.009822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43759e0a-d216-404f-ae5d-d015939afb3f None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:29.010336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43759e0a-d216-404f-ae5d-d015939afb3f None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:29.010441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43759e0a-d216-404f-ae5d-d015939afb3f None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:29.012299 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 174/335] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:29.019559 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c9b25-c853-487e-ad5f-e8d1a7e5099d None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:29.020551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c9b25-c853-487e-ad5f-e8d1a7e5099d None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:29.021090 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c9b25-c853-487e-ad5f-e8d1a7e5099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:29.047875 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-ee3c9b25-c853-487e-ad5f-e8d1a7e5099d None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:29.049530 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-ee3c9b25-c853-487e-ad5f-e8d1a7e5099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:29.135467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:29.154346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 162/336] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:29.524608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43759e0a-d216-404f-ae5d-d015939afb3f None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:29.554781 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:29.644252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43759e0a-d216-404f-ae5d-d015939afb3f None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:29.682154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b5f6a-f322-4ad6-ada2-972e207f5c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:29.682792 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b5f6a-f322-4ad6-ada2-972e207f5c32 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:29.683065 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b5f6a-f322-4ad6-ada2-972e207f5c32 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:29.683382 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b5f6a-f322-4ad6-ada2-972e207f5c32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:29.696452 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b5f6a-f322-4ad6-ada2-972e207f5c32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-051b5f6a-f322-4ad6-ada2-972e207f5c32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:29.702306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:29.703185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:29.704020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:29.704020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:29.704020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:29.704020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:29.704020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:29.704020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:29.704020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:29.704020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:29.704020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:29.704020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:29.704020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:29.704020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:29.704020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 175/337] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:29.711039 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c9b25-c853-487e-ad5f-e8d1a7e5099d None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:29.877147 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c9b25-c853-487e-ad5f-e8d1a7e5099d None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:29.922724 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44490d5a-9ba2-4599-baf3-0c35cce2e47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:29.923387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44490d5a-9ba2-4599-baf3-0c35cce2e47c None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:29.923667 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44490d5a-9ba2-4599-baf3-0c35cce2e47c None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:29.923943 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44490d5a-9ba2-4599-baf3-0c35cce2e47c None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:29.924612 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44490d5a-9ba2-4599-baf3-0c35cce2e47c None admin] RBAC: Adding query filter params (name=member) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:29.924915 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44490d5a-9ba2-4599-baf3-0c35cce2e47c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:29.926469 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44490d5a-9ba2-4599-baf3-0c35cce2e47c None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:29.936659 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 163/338] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:29.942237 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b5f6a-f322-4ad6-ada2-972e207f5c32 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:30.069569 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:30.091449 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b5f6a-f322-4ad6-ada2-972e207f5c32 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:30.152249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12b7d-b401-40f7-a6da-3acbc01b23b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:30.152249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12b7d-b401-40f7-a6da-3acbc01b23b2 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:30.152249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12b7d-b401-40f7-a6da-3acbc01b23b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:30.152249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12b7d-b401-40f7-a6da-3acbc01b23b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:30.244821 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b12b7d-b401-40f7-a6da-3acbc01b23b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:30.246300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b12b7d-b401-40f7-a6da-3acbc01b23b2 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:30.366211 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:30.386112 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 176/339] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:30.396416 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44490d5a-9ba2-4599-baf3-0c35cce2e47c None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:30.479667 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:30.554931 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44490d5a-9ba2-4599-baf3-0c35cce2e47c None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:30.603554 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82429d-0d47-49eb-bff6-e0a491a66fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:30.604220 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82429d-0d47-49eb-bff6-e0a491a66fb3 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:30.604554 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82429d-0d47-49eb-bff6-e0a491a66fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:30.604768 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82429d-0d47-49eb-bff6-e0a491a66fb3 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:30.617296 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82429d-0d47-49eb-bff6-e0a491a66fb3 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:30.620412 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82429d-0d47-49eb-bff6-e0a491a66fb3 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:30.622250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 164/340] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:30 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:30.628416 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12b7d-b401-40f7-a6da-3acbc01b23b2 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:30.645025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d59d08-2a77-4cd0-9faf-affe95cf506f None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:30.645331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d59d08-2a77-4cd0-9faf-affe95cf506f None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:30.645641 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d59d08-2a77-4cd0-9faf-affe95cf506f None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:30.646981 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 165/341] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:25:30.652764 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c884eb-b1fc-4274-9e1e-b489f4c4f2f0 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:30.653048 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c884eb-b1fc-4274-9e1e-b489f4c4f2f0 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:30.653331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c884eb-b1fc-4274-9e1e-b489f4c4f2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:30.685905 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-a6c884eb-b1fc-4274-9e1e-b489f4c4f2f0 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:30.687129 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-a6c884eb-b1fc-4274-9e1e-b489f4c4f2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:30.807400 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 166/342] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:30.808839 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7838c0-8c15-4ead-a3e7-f60ed8d39163 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:30.809123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7838c0-8c15-4ead-a3e7-f60ed8d39163 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:30.809394 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7838c0-8c15-4ead-a3e7-f60ed8d39163 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:30.813901 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 167/343] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:30.815170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296fa26-4c34-4e09-9d25-ac3bfbb8d36d None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:30.821876 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296fa26-4c34-4e09-9d25-ac3bfbb8d36d None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:30.822172 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296fa26-4c34-4e09-9d25-ac3bfbb8d36d None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:30.826188 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 168/344] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:30.827442 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c5b8-5b0a-4403-aa1d-7c45c5a0c2ee None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:30.827724 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c5b8-5b0a-4403-aa1d-7c45c5a0c2ee None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:30.833770 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c5b8-5b0a-4403-aa1d-7c45c5a0c2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:30.867681 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12b7d-b401-40f7-a6da-3acbc01b23b2 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:30.875497 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-35e1c5b8-5b0a-4403-aa1d-7c45c5a0c2ee None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:30.876719 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-35e1c5b8-5b0a-4403-aa1d-7c45c5a0c2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:30.931123 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1c20f-96fe-40ec-800e-3e16ee9aad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:30.938704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1c20f-96fe-40ec-800e-3e16ee9aad06 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:30.938704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1c20f-96fe-40ec-800e-3e16ee9aad06 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:30.938704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1c20f-96fe-40ec-800e-3e16ee9aad06 None admin] PATH_INFO: `/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:30.939623 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1c20f-96fe-40ec-800e-3e16ee9aad06 None admin] RBAC: Authorizing `identity:get_group(group_id=bbfa0adcdff2403786df4240ce4dd8e3)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:30.940086 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:30.941525 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1c20f-96fe-40ec-800e-3e16ee9aad06 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:30.943663 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 177/345] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:30 2022] GET /identity/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3 => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:30.945190 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9a746-09e7-482c-ad6f-71d94da28aec None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:30.945654 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9a746-09e7-482c-ad6f-71d94da28aec None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:30.946094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9a746-09e7-482c-ad6f-71d94da28aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:30.968547 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-e5f9a746-09e7-482c-ad6f-71d94da28aec None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:30.970044 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-e5f9a746-09e7-482c-ad6f-71d94da28aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:30.976815 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 169/346] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:30.983248 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b335-eab4-4202-855b-d76b187f4a75 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:30.983248 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b335-eab4-4202-855b-d76b187f4a75 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:30.983248 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b335-eab4-4202-855b-d76b187f4a75 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:30.983248 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 170/347] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:30.983248 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26b335-eab4-4202-855b-d76b187f4a75 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:31.087267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:31.141021 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26b335-eab4-4202-855b-d76b187f4a75 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:31.155092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 178/348] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:31.156707 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d5b49-2c31-4206-9029-fcde7066b520 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:31.157177 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d5b49-2c31-4206-9029-fcde7066b520 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:31.157554 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d5b49-2c31-4206-9029-fcde7066b520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:31.196348 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607346f-783b-497f-9a92-2c3e66bde0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:31.197205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607346f-783b-497f-9a92-2c3e66bde0fb None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:31.197655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607346f-783b-497f-9a92-2c3e66bde0fb None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:31.198065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607346f-783b-497f-9a92-2c3e66bde0fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:31.198945 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607346f-783b-497f-9a92-2c3e66bde0fb None admin] RBAC: Adding query filter params (group.id=bbfa0adcdff2403786df4240ce4dd8e3, role.id=4bc1625db2f14e779d8acb4d21d9d3f1, scope.project.id=39c3c57ed064477baba507d8cda5eee4) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:31.199437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607346f-783b-497f-9a92-2c3e66bde0fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:31.200965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-131d5b49-2c31-4206-9029-fcde7066b520 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:31.201869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607346f-783b-497f-9a92-2c3e66bde0fb None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:31.202360 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-131d5b49-2c31-4206-9029-fcde7066b520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:31.213018 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 171/349] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Aug 23 16:25:30 2022] GET /identity/v3/role_assignments?group.id=bbfa0adcdff2403786df4240ce4dd8e3&scope.project.id=39c3c57ed064477baba507d8cda5eee4&role.id=4bc1625db2f14e779d8acb4d21d9d3f1 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:31.278426 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607346f-783b-497f-9a92-2c3e66bde0fb None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:31.321557 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 179/350] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:31.339938 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:31.423631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607346f-783b-497f-9a92-2c3e66bde0fb None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:31.469278 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5e1ee-0d23-4331-b1b4-c744ec089d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:31.469933 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5e1ee-0d23-4331-b1b4-c744ec089d09 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:31.470207 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5e1ee-0d23-4331-b1b4-c744ec089d09 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:31.470476 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5e1ee-0d23-4331-b1b4-c744ec089d09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:31.484045 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5e1ee-0d23-4331-b1b4-c744ec089d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-5de5e1ee-0d23-4331-b1b4-c744ec089d09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:31.489465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:31.490435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:31.491324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:31.491324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:31.491324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:31.491324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:31.491324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:31.491324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:31.491324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:31.491324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:31.491324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:31.491324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:31.491324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:31.491324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:31.492980 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 172/351] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:25:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:25:31.499300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d5b49-2c31-4206-9029-fcde7066b520 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:31.571355 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5e1ee-0d23-4331-b1b4-c744ec089d09 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:31.651641 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d5b49-2c31-4206-9029-fcde7066b520 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:31.670101 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:31.722755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7e12c-8c87-44c6-b58d-778ef584f473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:31.724054 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7e12c-8c87-44c6-b58d-778ef584f473 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:31.724481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7e12c-8c87-44c6-b58d-778ef584f473 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:31.724902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7e12c-8c87-44c6-b58d-778ef584f473 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:31.725966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7e12c-8c87-44c6-b58d-778ef584f473 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:31.726437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7e12c-8c87-44c6-b58d-778ef584f473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:31.728974 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7e12c-8c87-44c6-b58d-778ef584f473 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:31.760250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 180/352] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:31.761513 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7e12c-8c87-44c6-b58d-778ef584f473 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:31.820462 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:31.826717 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5e1ee-0d23-4331-b1b4-c744ec089d09 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:31.881943 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a0c4a-5f5b-4be5-8e83-4c4a2884b255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:31.883046 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a0c4a-5f5b-4be5-8e83-4c4a2884b255 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:31.883356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a0c4a-5f5b-4be5-8e83-4c4a2884b255 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:31.883898 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a0c4a-5f5b-4be5-8e83-4c4a2884b255 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:31.900515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a0c4a-5f5b-4be5-8e83-4c4a2884b255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-ee8a0c4a-5f5b-4be5-8e83-4c4a2884b255 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:31.907275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:31.908211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:31.909038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:31.909038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:31.909038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:31.909038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:31.909038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:31.909038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:31.909038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:31.909038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:31.909038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:31.909038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:31.909038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:31.909038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:31.909038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 173/353] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:31.910383 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a0c4a-5f5b-4be5-8e83-4c4a2884b255 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:31.938530 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7e12c-8c87-44c6-b58d-778ef584f473 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:31.988953 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19fed4-eabc-4a19-a8b9-26f983b358ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:31.989853 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19fed4-eabc-4a19-a8b9-26f983b358ce None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:31.990128 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19fed4-eabc-4a19-a8b9-26f983b358ce None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:31.990398 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19fed4-eabc-4a19-a8b9-26f983b358ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:32.006307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19fed4-eabc-4a19-a8b9-26f983b358ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-1d19fed4-eabc-4a19-a8b9-26f983b358ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:32.012538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:32.014715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 181/354] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:32.016462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19fed4-eabc-4a19-a8b9-26f983b358ce None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:32.046865 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a0c4a-5f5b-4be5-8e83-4c4a2884b255 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:32.060980 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:32.104116 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34564f-c6af-4c87-8dad-7ceb95b56b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:32.104775 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34564f-c6af-4c87-8dad-7ceb95b56b7a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:32.105058 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34564f-c6af-4c87-8dad-7ceb95b56b7a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:32.105334 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34564f-c6af-4c87-8dad-7ceb95b56b7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:32.142285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:32.167497 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19fed4-eabc-4a19-a8b9-26f983b358ce None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:32.190309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34564f-c6af-4c87-8dad-7ceb95b56b7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:32.191819 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34564f-c6af-4c87-8dad-7ceb95b56b7a None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:32.213293 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81480d19-3c79-476c-8862-68ae3c41aa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:32.214001 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81480d19-3c79-476c-8862-68ae3c41aa1a None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:32.214277 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81480d19-3c79-476c-8862-68ae3c41aa1a None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:32.214579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81480d19-3c79-476c-8862-68ae3c41aa1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:32.228430 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81480d19-3c79-476c-8862-68ae3c41aa1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-81480d19-3c79-476c-8862-68ae3c41aa1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:32.233704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:32.234826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 182/355] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:25:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:32.235920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81480d19-3c79-476c-8862-68ae3c41aa1a None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:32.326909 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 174/356] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:32.328045 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34564f-c6af-4c87-8dad-7ceb95b56b7a None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:32.350097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:32.360600 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81480d19-3c79-476c-8862-68ae3c41aa1a None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:32.400697 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:32.411831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7c3a8-fb2b-4b24-8784-53696d33277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:32.412414 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7c3a8-fb2b-4b24-8784-53696d33277c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:32.412685 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7c3a8-fb2b-4b24-8784-53696d33277c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:32.412952 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7c3a8-fb2b-4b24-8784-53696d33277c None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:32.413609 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7c3a8-fb2b-4b24-8784-53696d33277c None admin] RBAC: Adding query filter params (name=member) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:32.413909 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7c3a8-fb2b-4b24-8784-53696d33277c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:32.415306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7c3a8-fb2b-4b24-8784-53696d33277c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:32.424705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 183/357] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:32.425874 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff4df1-5a25-495c-aa41-c61b46765e8d None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:32.426153 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff4df1-5a25-495c-aa41-c61b46765e8d None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:32.426420 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff4df1-5a25-495c-aa41-c61b46765e8d None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:32.432582 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 184/358] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:32.433388 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff4df1-5a25-495c-aa41-c61b46765e8d None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:32.455043 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34564f-c6af-4c87-8dad-7ceb95b56b7a None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:32.509002 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea3fd8-92aa-4496-8801-d7e9a180a64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:32.509753 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea3fd8-92aa-4496-8801-d7e9a180a64b None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:32.510143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea3fd8-92aa-4496-8801-d7e9a180a64b None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:32.510419 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea3fd8-92aa-4496-8801-d7e9a180a64b None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:32.511240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea3fd8-92aa-4496-8801-d7e9a180a64b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:32.511550 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea3fd8-92aa-4496-8801-d7e9a180a64b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:32.514222 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea3fd8-92aa-4496-8801-d7e9a180a64b None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:32.527451 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 175/359] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:32.528347 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea3fd8-92aa-4496-8801-d7e9a180a64b None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:32.567715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff4df1-5a25-495c-aa41-c61b46765e8d None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:32.614133 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c91f8-403e-4939-a4f5-6df3de2eb564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:32.615073 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c91f8-403e-4939-a4f5-6df3de2eb564 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:32.615483 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c91f8-403e-4939-a4f5-6df3de2eb564 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:32.615902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c91f8-403e-4939-a4f5-6df3de2eb564 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:32.616596 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c91f8-403e-4939-a4f5-6df3de2eb564 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:32.616903 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c91f8-403e-4939-a4f5-6df3de2eb564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:32.618375 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c91f8-403e-4939-a4f5-6df3de2eb564 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:32.632886 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 185/360] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:32.634096 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c91f8-403e-4939-a4f5-6df3de2eb564 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:32.655899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:32.661400 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea3fd8-92aa-4496-8801-d7e9a180a64b None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:32.693346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:32.709367 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ade89f-0896-4ae6-a990-5fc624c57662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:32.715030 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ade89f-0896-4ae6-a990-5fc624c57662 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:32.715030 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ade89f-0896-4ae6-a990-5fc624c57662 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:32.715030 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ade89f-0896-4ae6-a990-5fc624c57662 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:32.715030 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ade89f-0896-4ae6-a990-5fc624c57662 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:32.715030 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ade89f-0896-4ae6-a990-5fc624c57662 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:32.716264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 176/361] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:32 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:32.716811 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396549e-7f16-4190-9f16-3a2d6ff4b10e None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:32.717060 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396549e-7f16-4190-9f16-3a2d6ff4b10e None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:32.717335 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396549e-7f16-4190-9f16-3a2d6ff4b10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:32.736494 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-3396549e-7f16-4190-9f16-3a2d6ff4b10e None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:32.737728 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-3396549e-7f16-4190-9f16-3a2d6ff4b10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:32.777637 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c91f8-403e-4939-a4f5-6df3de2eb564 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:32.818485 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b68e4-1ce7-43e0-8d9b-f9cb401f744d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:32.819441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b68e4-1ce7-43e0-8d9b-f9cb401f744d None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:32.819723 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b68e4-1ce7-43e0-8d9b-f9cb401f744d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:32.820001 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b68e4-1ce7-43e0-8d9b-f9cb401f744d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:32.839516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 177/362] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:32.840979 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396549e-7f16-4190-9f16-3a2d6ff4b10e None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:32.927114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b68e4-1ce7-43e0-8d9b-f9cb401f744d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:32.928843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b68e4-1ce7-43e0-8d9b-f9cb401f744d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:32.947339 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:32.978332 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396549e-7f16-4190-9f16-3a2d6ff4b10e None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:33.003332 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:33.021923 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59aeb18-99bd-4f7b-9b38-b9227ecf8fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:33.022892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aeb18-99bd-4f7b-9b38-b9227ecf8fca None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:33.023678 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aeb18-99bd-4f7b-9b38-b9227ecf8fca None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:33.024125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aeb18-99bd-4f7b-9b38-b9227ecf8fca None admin] PATH_INFO: `/v3/users/610ed2521b9d4bfe8e704204dac2fc51` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:33.025932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59aeb18-99bd-4f7b-9b38-b9227ecf8fca None admin] RBAC: Authorizing `identity:get_user(user_id=610ed2521b9d4bfe8e704204dac2fc51)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:33.027669 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59aeb18-99bd-4f7b-9b38-b9227ecf8fca None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:33.030689 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 178/363] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Aug 23 16:25:32 2022] GET /identity/v3/users/610ed2521b9d4bfe8e704204dac2fc51 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:33.031709 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59aeb18-99bd-4f7b-9b38-b9227ecf8fca None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:33.065236 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 186/364] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:33.065770 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b68e4-1ce7-43e0-8d9b-f9cb401f744d None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:33.178728 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59aeb18-99bd-4f7b-9b38-b9227ecf8fca None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:33.191670 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b68e4-1ce7-43e0-8d9b-f9cb401f744d None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:33.211331 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:33.235374 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b3682-1c11-44f9-af82-1d19377f90ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:33.236459 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b3682-1c11-44f9-af82-1d19377f90ee None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:33.236459 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b3682-1c11-44f9-af82-1d19377f90ee None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:33.237020 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b3682-1c11-44f9-af82-1d19377f90ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:33.239505 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d961c6e-4abe-447a-84c2-ba918244fe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:33.240353 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d961c6e-4abe-447a-84c2-ba918244fe9f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:33.240818 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d961c6e-4abe-447a-84c2-ba918244fe9f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:33.241354 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d961c6e-4abe-447a-84c2-ba918244fe9f None admin] PATH_INFO: `/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:33.243626 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d961c6e-4abe-447a-84c2-ba918244fe9f None admin] RBAC: Authorizing `identity:get_group(group_id=bbfa0adcdff2403786df4240ce4dd8e3)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:33.245291 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d961c6e-4abe-447a-84c2-ba918244fe9f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:33.247597 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 187/365] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:33 2022] GET /identity/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:33.248753 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d961c6e-4abe-447a-84c2-ba918244fe9f None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:33.311832 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:33.327494 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b3682-1c11-44f9-af82-1d19377f90ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:33.328973 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b3682-1c11-44f9-af82-1d19377f90ee None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:33.389296 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d961c6e-4abe-447a-84c2-ba918244fe9f None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:33.432152 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b4bee-60d9-4277-9e93-f2cb98399278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:33.432869 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b4bee-60d9-4277-9e93-f2cb98399278 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:33.433154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b4bee-60d9-4277-9e93-f2cb98399278 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:33.433431 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b4bee-60d9-4277-9e93-f2cb98399278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:33.435325 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b4bee-60d9-4277-9e93-f2cb98399278 None admin] RBAC: Adding query filter params (role.id=225f2a2bd302418485ac34ecb871c3e4, user.id=610ed2521b9d4bfe8e704204dac2fc51, scope.system=all) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:33.435701 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b4bee-60d9-4277-9e93-f2cb98399278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:33.437516 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b4bee-60d9-4277-9e93-f2cb98399278 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:33.455304 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 188/366] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Aug 23 16:25:33 2022] GET /identity/v3/role_assignments?user.id=610ed2521b9d4bfe8e704204dac2fc51&scope.system=all&role.id=225f2a2bd302418485ac34ecb871c3e4 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:33.456350 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b4bee-60d9-4277-9e93-f2cb98399278 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:33.461946 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 179/367] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:33.468848 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b3682-1c11-44f9-af82-1d19377f90ee None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:33.514820 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:33.594490 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b4bee-60d9-4277-9e93-f2cb98399278 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:33.603391 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:33.610922 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b3682-1c11-44f9-af82-1d19377f90ee None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:33.641273 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7041fd1-7575-4c42-ad8a-919e797fee95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:33.641928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7041fd1-7575-4c42-ad8a-919e797fee95 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:33.642210 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7041fd1-7575-4c42-ad8a-919e797fee95 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:33.642485 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7041fd1-7575-4c42-ad8a-919e797fee95 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:33.643769 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7041fd1-7575-4c42-ad8a-919e797fee95 None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:33.645314 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7041fd1-7575-4c42-ad8a-919e797fee95 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:33.647012 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 189/368] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:33 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:33.647921 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7041fd1-7575-4c42-ad8a-919e797fee95 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:33.665293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15f712-621f-4ca6-87e0-28378e938ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:33.666209 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15f712-621f-4ca6-87e0-28378e938ae9 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:33.666486 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15f712-621f-4ca6-87e0-28378e938ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:33.666757 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15f712-621f-4ca6-87e0-28378e938ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:33.667728 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15f712-621f-4ca6-87e0-28378e938ae9 None admin] RBAC: Adding query filter params (group.id=bbfa0adcdff2403786df4240ce4dd8e3, role.id=1f86135571074da38ac7d898436a8862, scope.project.id=39c3c57ed064477baba507d8cda5eee4) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:33.668043 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15f712-621f-4ca6-87e0-28378e938ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:33.670315 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15f712-621f-4ca6-87e0-28378e938ae9 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:33.677060 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 180/369] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Aug 23 16:25:33 2022] GET /identity/v3/role_assignments?group.id=bbfa0adcdff2403786df4240ce4dd8e3&scope.project.id=39c3c57ed064477baba507d8cda5eee4&role.id=1f86135571074da38ac7d898436a8862 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:33.678461 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15f712-621f-4ca6-87e0-28378e938ae9 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:33.790881 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7041fd1-7575-4c42-ad8a-919e797fee95 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:33.802688 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:33.818496 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15f712-621f-4ca6-87e0-28378e938ae9 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:33.834442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67553c-3264-4c8c-a5f2-8e5a77ccb740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:33.835098 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67553c-3264-4c8c-a5f2-8e5a77ccb740 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:33.835414 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67553c-3264-4c8c-a5f2-8e5a77ccb740 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:33.835692 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67553c-3264-4c8c-a5f2-8e5a77ccb740 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:33.849424 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67553c-3264-4c8c-a5f2-8e5a77ccb740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-ee67553c-3264-4c8c-a5f2-8e5a77ccb740 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:33.855676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:33.857423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:33.858284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:33.858284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:33.858284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:33.858284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:33.858284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:33.858284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:33.858284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:33.858284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:33.858284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:33.858284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:33.858284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:33.858284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:33.860476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 190/370] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:25:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:33.861655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67553c-3264-4c8c-a5f2-8e5a77ccb740 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:33.873988 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df4057-274d-427a-8e62-105eca2fe5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:33.875216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4057-274d-427a-8e62-105eca2fe5ce None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:33.875846 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4057-274d-427a-8e62-105eca2fe5ce None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:33.876343 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4057-274d-427a-8e62-105eca2fe5ce None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:33.878285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df4057-274d-427a-8e62-105eca2fe5ce None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:33.880586 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df4057-274d-427a-8e62-105eca2fe5ce None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:33.882870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 181/371] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:33 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:33.884922 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df4057-274d-427a-8e62-105eca2fe5ce None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:33.912261 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:33.993862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67553c-3264-4c8c-a5f2-8e5a77ccb740 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:34.006623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df4057-274d-427a-8e62-105eca2fe5ce None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:34.046020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3dbc0-2e85-4e6e-b04e-c076d36bb00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:34.047068 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3dbc0-2e85-4e6e-b04e-c076d36bb00a None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:34.048697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3dbc0-2e85-4e6e-b04e-c076d36bb00a None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:34.049198 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3dbc0-2e85-4e6e-b04e-c076d36bb00a None admin] PATH_INFO: `/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:34.050724 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3dbc0-2e85-4e6e-b04e-c076d36bb00a None admin] RBAC: Authorizing `identity:get_group(group_id=bbfa0adcdff2403786df4240ce4dd8e3)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:34.052515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3dbc0-2e85-4e6e-b04e-c076d36bb00a None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:34.054728 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 191/372] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:33 2022] GET /identity/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:34.055823 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3dbc0-2e85-4e6e-b04e-c076d36bb00a None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:34.058163 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755ab37-f51a-4f8c-bbfe-ad58486451cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:34.059148 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755ab37-f51a-4f8c-bbfe-ad58486451cd None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:34.060074 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755ab37-f51a-4f8c-bbfe-ad58486451cd None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:34.060411 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755ab37-f51a-4f8c-bbfe-ad58486451cd None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:34.062106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755ab37-f51a-4f8c-bbfe-ad58486451cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:34.062499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755ab37-f51a-4f8c-bbfe-ad58486451cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:34.063977 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755ab37-f51a-4f8c-bbfe-ad58486451cd None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:34.079267 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 182/373] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:34.079267 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755ab37-f51a-4f8c-bbfe-ad58486451cd None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:34.107535 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:34.196345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:34.202644 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3dbc0-2e85-4e6e-b04e-c076d36bb00a None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:34.216111 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755ab37-f51a-4f8c-bbfe-ad58486451cd None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:34.258965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c27c27-9384-4f0a-a8ef-975e578062bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:34.260059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c27c27-9384-4f0a-a8ef-975e578062bb None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:34.260541 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c27c27-9384-4f0a-a8ef-975e578062bb None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:34.261038 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c27c27-9384-4f0a-a8ef-975e578062bb None admin] PATH_INFO: `/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:34.262414 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c27c27-9384-4f0a-a8ef-975e578062bb None admin] RBAC: Authorizing `identity:get_group(group_id=bbfa0adcdff2403786df4240ce4dd8e3)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:34.264555 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c27c27-9384-4f0a-a8ef-975e578062bb None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:34.266264 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 192/374] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:34 2022] GET /identity/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:34.271114 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601eaa05-8089-4225-a684-1be1856f1057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:34.271826 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601eaa05-8089-4225-a684-1be1856f1057 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:34.272102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601eaa05-8089-4225-a684-1be1856f1057 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:34.272202 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c27c27-9384-4f0a-a8ef-975e578062bb None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:34.272370 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601eaa05-8089-4225-a684-1be1856f1057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:34.273110 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601eaa05-8089-4225-a684-1be1856f1057 None admin] RBAC: Adding query filter params (group.id=bbfa0adcdff2403786df4240ce4dd8e3, role.id=4bc1625db2f14e779d8acb4d21d9d3f1, scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:34.273681 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601eaa05-8089-4225-a684-1be1856f1057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:34.275277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601eaa05-8089-4225-a684-1be1856f1057 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:34.283044 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 183/375] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Aug 23 16:25:34 2022] GET /identity/v3/role_assignments?group.id=bbfa0adcdff2403786df4240ce4dd8e3&scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c&role.id=4bc1625db2f14e779d8acb4d21d9d3f1 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:34.284417 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97fd49-db3d-4a32-b8ac-8a6e55d59279 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:34.284702 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97fd49-db3d-4a32-b8ac-8a6e55d59279 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:34.284972 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97fd49-db3d-4a32-b8ac-8a6e55d59279 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:34.286715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 184/376] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:34.287566 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97fd49-db3d-4a32-b8ac-8a6e55d59279 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:34.441513 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c27c27-9384-4f0a-a8ef-975e578062bb None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:34.445771 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:34.458545 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97fd49-db3d-4a32-b8ac-8a6e55d59279 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:34.491306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55eae-b852-4ab3-81ff-b83bcdc0ccdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:34.492288 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55eae-b852-4ab3-81ff-b83bcdc0ccdb None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:34.492866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55eae-b852-4ab3-81ff-b83bcdc0ccdb None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:34.493332 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55eae-b852-4ab3-81ff-b83bcdc0ccdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:34.506577 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf565aa-d109-4a42-b8e5-108545c36a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:34.507218 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf565aa-d109-4a42-b8e5-108545c36a8c None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:34.507511 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf565aa-d109-4a42-b8e5-108545c36a8c None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:34.507780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf565aa-d109-4a42-b8e5-108545c36a8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:34.508673 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf565aa-d109-4a42-b8e5-108545c36a8c None admin] RBAC: Adding query filter params (group.id=bbfa0adcdff2403786df4240ce4dd8e3, role.id=1f86135571074da38ac7d898436a8862, scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:34.509858 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf565aa-d109-4a42-b8e5-108545c36a8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:34.510289 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf565aa-d109-4a42-b8e5-108545c36a8c None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:34.516617 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 185/377] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Aug 23 16:25:34 2022] GET /identity/v3/role_assignments?group.id=bbfa0adcdff2403786df4240ce4dd8e3&scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c&role.id=1f86135571074da38ac7d898436a8862 => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:34.517873 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1008ca9-ccaf-4f9b-8b1c-82bc444e0639 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:34.518154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1008ca9-ccaf-4f9b-8b1c-82bc444e0639 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:34.518426 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1008ca9-ccaf-4f9b-8b1c-82bc444e0639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:34.544449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-d1008ca9-ccaf-4f9b-8b1c-82bc444e0639 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:34.545824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-d1008ca9-ccaf-4f9b-8b1c-82bc444e0639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:34.549222 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:34.604398 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55eae-b852-4ab3-81ff-b83bcdc0ccdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:34.609495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55eae-b852-4ab3-81ff-b83bcdc0ccdb None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:34.696845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 186/378] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:34.758730 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 193/379] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:34.768463 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1008ca9-ccaf-4f9b-8b1c-82bc444e0639 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:34.914865 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1008ca9-ccaf-4f9b-8b1c-82bc444e0639 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:34.951885 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ce14a-f7e4-4054-82cc-5e03d2a63adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:34.952864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ce14a-f7e4-4054-82cc-5e03d2a63adf None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:34.953344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ce14a-f7e4-4054-82cc-5e03d2a63adf None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:34.953814 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ce14a-f7e4-4054-82cc-5e03d2a63adf None admin] PATH_INFO: `/v3/projects/8f03f75490504c439981665b0cba53a2` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:34.955172 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ce14a-f7e4-4054-82cc-5e03d2a63adf None admin] RBAC: Authorizing `identity:get_project(project_id=8f03f75490504c439981665b0cba53a2)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:34.956981 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ce14a-f7e4-4054-82cc-5e03d2a63adf None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:34.959208 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 187/380] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:34 2022] GET /identity/v3/projects/8f03f75490504c439981665b0cba53a2 => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:34.968391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55eae-b852-4ab3-81ff-b83bcdc0ccdb None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:34.979610 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:35.101800 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55eae-b852-4ab3-81ff-b83bcdc0ccdb None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:35.109770 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ce14a-f7e4-4054-82cc-5e03d2a63adf None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:35.128240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:35.195125 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d0f91-a82e-45d5-84ea-88a68ea76931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:35.196338 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d0f91-a82e-45d5-84ea-88a68ea76931 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:35.197586 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d0f91-a82e-45d5-84ea-88a68ea76931 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:35.198240 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d0f91-a82e-45d5-84ea-88a68ea76931 None admin] PATH_INFO: `/v3/groups/844142de74804e45b2b87f7597e8a2d0` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:35.209443 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d0f91-a82e-45d5-84ea-88a68ea76931 None admin] RBAC: Authorizing `identity:get_group(group_id=844142de74804e45b2b87f7597e8a2d0)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:35.211855 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d0f91-a82e-45d5-84ea-88a68ea76931 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:35.214114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 194/381] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:34 2022] GET /identity/v3/groups/844142de74804e45b2b87f7597e8a2d0 => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:35.225354 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d0f91-a82e-45d5-84ea-88a68ea76931 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:35.308876 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ce14a-f7e4-4054-82cc-5e03d2a63adf None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:35.353039 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05050-ba2c-458a-ae58-ffeb5b954671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:35.353938 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05050-ba2c-458a-ae58-ffeb5b954671 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:35.354280 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05050-ba2c-458a-ae58-ffeb5b954671 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:35.354555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05050-ba2c-458a-ae58-ffeb5b954671 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:35.369247 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a05050-ba2c-458a-ae58-ffeb5b954671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-a1a05050-ba2c-458a-ae58-ffeb5b954671 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:35.374472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:35.375422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:35.376238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:35.376238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:35.376238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:35.376238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:35.376238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:35.376238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:35.376238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:35.376238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:35.376238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:35.376238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:35.376238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:35.376238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:35.376238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 188/382] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:35.379163 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:35.388946 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05050-ba2c-458a-ae58-ffeb5b954671 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:35.424350 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d0f91-a82e-45d5-84ea-88a68ea76931 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:35.462310 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f4a8a-c553-4248-87de-654700cb911f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:35.463315 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f4a8a-c553-4248-87de-654700cb911f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:35.463841 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f4a8a-c553-4248-87de-654700cb911f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:35.464327 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f4a8a-c553-4248-87de-654700cb911f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:35.465250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f4a8a-c553-4248-87de-654700cb911f None admin] RBAC: Adding query filter params (group.id=844142de74804e45b2b87f7597e8a2d0, role.id=091802a86e334e129210219b7c69359d, scope.project.id=8f03f75490504c439981665b0cba53a2) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:35.466329 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f4a8a-c553-4248-87de-654700cb911f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:35.468016 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f4a8a-c553-4248-87de-654700cb911f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:35.474573 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 195/383] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Aug 23 16:25:35 2022] GET /identity/v3/role_assignments?group.id=844142de74804e45b2b87f7597e8a2d0&scope.project.id=8f03f75490504c439981665b0cba53a2&role.id=091802a86e334e129210219b7c69359d => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:35.503690 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:35.555325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05050-ba2c-458a-ae58-ffeb5b954671 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:35.604744 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c6155-86b1-4fbe-8820-220c575c0399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:35.605380 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c6155-86b1-4fbe-8820-220c575c0399 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:35.605664 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c6155-86b1-4fbe-8820-220c575c0399 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:35.605941 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c6155-86b1-4fbe-8820-220c575c0399 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:35.606673 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c6155-86b1-4fbe-8820-220c575c0399 None admin] RBAC: Adding query filter params (name=member) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:35.606978 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c6155-86b1-4fbe-8820-220c575c0399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:35.608390 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c6155-86b1-4fbe-8820-220c575c0399 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:35.617907 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 189/384] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:35.624785 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f4a8a-c553-4248-87de-654700cb911f None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:35.799977 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f4a8a-c553-4248-87de-654700cb911f None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:35.836928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:35.841913 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f618b53-f009-49e0-81fd-324551429576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:35.842553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f618b53-f009-49e0-81fd-324551429576 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:35.842832 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f618b53-f009-49e0-81fd-324551429576 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:35.843107 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f618b53-f009-49e0-81fd-324551429576 None admin] PATH_INFO: `/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:35.847932 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f618b53-f009-49e0-81fd-324551429576 None admin] RBAC: Authorizing `identity:get_group(group_id=bbfa0adcdff2403786df4240ce4dd8e3)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:35.849402 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f618b53-f009-49e0-81fd-324551429576 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:35.851388 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 196/385] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:35 2022] GET /identity/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:35.857702 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c6155-86b1-4fbe-8820-220c575c0399 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:36.000159 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c6155-86b1-4fbe-8820-220c575c0399 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:36.039424 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:36.049845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b0c4b-2712-4933-81f8-8a28400710e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:36.050502 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b0c4b-2712-4933-81f8-8a28400710e1 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:36.050785 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b0c4b-2712-4933-81f8-8a28400710e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:36.051062 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b0c4b-2712-4933-81f8-8a28400710e1 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:36.052246 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b0c4b-2712-4933-81f8-8a28400710e1 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:36.053708 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b0c4b-2712-4933-81f8-8a28400710e1 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:36.055604 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 190/386] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:35 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:36.061956 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f618b53-f009-49e0-81fd-324551429576 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:36.256859 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f618b53-f009-49e0-81fd-324551429576 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:36.312155 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d988d-b060-4e16-9f74-67e7e4c80d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:36.313159 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d988d-b060-4e16-9f74-67e7e4c80d94 None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:36.313640 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d988d-b060-4e16-9f74-67e7e4c80d94 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:36.314138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d988d-b060-4e16-9f74-67e7e4c80d94 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4/groups/bbfa0adcdff2403786df4240ce4dd8e3/roles/4bc1625db2f14e779d8acb4d21d9d3f1` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:36.316288 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d988d-b060-4e16-9f74-67e7e4c80d94 None admin] RBAC: Authorizing `identity:create_grant(project_id=39c3c57ed064477baba507d8cda5eee4, group_id=bbfa0adcdff2403786df4240ce4dd8e3, role_id=4bc1625db2f14e779d8acb4d21d9d3f1)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:36.317965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d988d-b060-4e16-9f74-67e7e4c80d94 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:36.429791 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baff18e-88e8-4c8b-8585-600cdd133860 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:36.430104 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baff18e-88e8-4c8b-8585-600cdd133860 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:36.430345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baff18e-88e8-4c8b-8585-600cdd133860 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:36.431982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 191/387] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:36.437381 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2385f-0536-4c7d-8654-13799ad50268 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:36.437665 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2385f-0536-4c7d-8654-13799ad50268 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:36.437946 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2385f-0536-4c7d-8654-13799ad50268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:36.438889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 197/388] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Aug 23 16:25:36 2022] PUT /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4/groups/bbfa0adcdff2403786df4240ce4dd8e3/roles/4bc1625db2f14e779d8acb4d21d9d3f1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:25:36.457629 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-c8e2385f-0536-4c7d-8654-13799ad50268 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:36.459257 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-c8e2385f-0536-4c7d-8654-13799ad50268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:36.557230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 192/389] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:36.990877 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d988d-b060-4e16-9f74-67e7e4c80d94 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:37.067900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:37.114179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d988d-b060-4e16-9f74-67e7e4c80d94 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:37.160817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad2419-eda9-4d3d-b1df-52a720713221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:37.161528 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad2419-eda9-4d3d-b1df-52a720713221 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:37.161817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad2419-eda9-4d3d-b1df-52a720713221 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:37.162089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad2419-eda9-4d3d-b1df-52a720713221 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:37.176370 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad2419-eda9-4d3d-b1df-52a720713221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-3dad2419-eda9-4d3d-b1df-52a720713221 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:37.182421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:37.183381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:37.184165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:37.184165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:37.184165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:37.184165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:37.184165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:37.184165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:37.184165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:37.184165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:37.184165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:37.184165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:37.184165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:37.184165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:37.184165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 198/390] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:25:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:37.190754 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fa392-fa2d-44b3-9e39-d7972246f035 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:37.191064 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fa392-fa2d-44b3-9e39-d7972246f035 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:37.191765 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fa392-fa2d-44b3-9e39-d7972246f035 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:37.193869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 193/391] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:37.196175 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad2419-eda9-4d3d-b1df-52a720713221 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:37.199972 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe87bf-c904-4697-b821-c6624b255cad None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:37.200488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe87bf-c904-4697-b821-c6624b255cad None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:37.201001 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe87bf-c904-4697-b821-c6624b255cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:37.224007 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-7cbe87bf-c904-4697-b821-c6624b255cad None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:37.225197 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-7cbe87bf-c904-4697-b821-c6624b255cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:37.367447 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 194/392] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:37.383255 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad2419-eda9-4d3d-b1df-52a720713221 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:37.413042 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:37.438265 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cba007-a755-4cc3-99d2-129a6f5eae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:37.438932 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba007-a755-4cc3-99d2-129a6f5eae00 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:37.439212 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba007-a755-4cc3-99d2-129a6f5eae00 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:37.439513 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba007-a755-4cc3-99d2-129a6f5eae00 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:37.440304 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cba007-a755-4cc3-99d2-129a6f5eae00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:37.440616 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cba007-a755-4cc3-99d2-129a6f5eae00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:37.442179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cba007-a755-4cc3-99d2-129a6f5eae00 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:37.456638 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 199/393] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:37.462760 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe87bf-c904-4697-b821-c6624b255cad None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:37.545479 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:37.598399 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe87bf-c904-4697-b821-c6624b255cad None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:37.611578 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865af2c3-766a-4fd8-a10a-54dd427aaf8c None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:37.611923 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865af2c3-766a-4fd8-a10a-54dd427aaf8c None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:37.612200 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865af2c3-766a-4fd8-a10a-54dd427aaf8c None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:37.613520 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 200/394] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:25:37.619123 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff800c-0d13-4a07-b283-97b2e5b54516 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:37.619358 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff800c-0d13-4a07-b283-97b2e5b54516 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:37.619838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff800c-0d13-4a07-b283-97b2e5b54516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:37.649875 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5230db-cc40-425b-aee4-2faef6f0dfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:37.651039 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5230db-cc40-425b-aee4-2faef6f0dfec None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:37.651590 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5230db-cc40-425b-aee4-2faef6f0dfec None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:37.655021 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5230db-cc40-425b-aee4-2faef6f0dfec None admin] PATH_INFO: `/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:37.656404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5230db-cc40-425b-aee4-2faef6f0dfec None admin] RBAC: Authorizing `identity:get_group(group_id=bbfa0adcdff2403786df4240ce4dd8e3)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:37.658153 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-42ff800c-0d13-4a07-b283-97b2e5b54516 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:37.659388 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5230db-cc40-425b-aee4-2faef6f0dfec None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:37.660873 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-42ff800c-0d13-4a07-b283-97b2e5b54516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:37.664350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 195/395] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:37 2022] GET /identity/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:37.675853 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5230db-cc40-425b-aee4-2faef6f0dfec None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:37.797101 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 201/396] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:37.844637 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5230db-cc40-425b-aee4-2faef6f0dfec None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:37.879701 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:37.884356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38db3c4-9bf1-4b21-80b6-a8aceea275c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:37.885005 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38db3c4-9bf1-4b21-80b6-a8aceea275c2 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:37.885282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38db3c4-9bf1-4b21-80b6-a8aceea275c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:37.891329 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38db3c4-9bf1-4b21-80b6-a8aceea275c2 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:37.891329 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38db3c4-9bf1-4b21-80b6-a8aceea275c2 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:37.891329 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38db3c4-9bf1-4b21-80b6-a8aceea275c2 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:37.891329 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 196/397] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:37 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:37.899747 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff800c-0d13-4a07-b283-97b2e5b54516 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:37.948555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38db3c4-9bf1-4b21-80b6-a8aceea275c2 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:38.040723 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff800c-0d13-4a07-b283-97b2e5b54516 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:38.071597 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:38.114506 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9060bea-422c-413b-86b9-42c0e3b8dd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:38.115320 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9060bea-422c-413b-86b9-42c0e3b8dd35 None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:38.115602 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9060bea-422c-413b-86b9-42c0e3b8dd35 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:38.115989 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9060bea-422c-413b-86b9-42c0e3b8dd35 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4/groups/bbfa0adcdff2403786df4240ce4dd8e3/roles/1f86135571074da38ac7d898436a8862` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:38.122472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9060bea-422c-413b-86b9-42c0e3b8dd35 None admin] RBAC: Authorizing `identity:create_grant(project_id=39c3c57ed064477baba507d8cda5eee4, group_id=bbfa0adcdff2403786df4240ce4dd8e3, role_id=1f86135571074da38ac7d898436a8862)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:38.123947 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9060bea-422c-413b-86b9-42c0e3b8dd35 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:38.129413 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38db3c4-9bf1-4b21-80b6-a8aceea275c2 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:38.169931 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe8009-94a8-4eb3-a289-c4696a7a766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:38.170537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe8009-94a8-4eb3-a289-c4696a7a766a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:38.170810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe8009-94a8-4eb3-a289-c4696a7a766a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:38.171101 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe8009-94a8-4eb3-a289-c4696a7a766a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:38.181658 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe8009-94a8-4eb3-a289-c4696a7a766a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-47fe8009-94a8-4eb3-a289-c4696a7a766a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:38.186325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:38.187516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:38.188379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:38.188379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:38.188379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:38.188379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:38.188379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:38.188379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:38.188379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:38.188379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:38.188379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:38.188379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:38.188379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:38.188379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:38.188379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 197/398] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:25:38.189072 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800d7c8-563e-42dd-9135-274797f74b5b None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:38.190701 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800d7c8-563e-42dd-9135-274797f74b5b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:38.191239 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800d7c8-563e-42dd-9135-274797f74b5b None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:38.192880 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 198/399] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:38.197678 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800d7c8-563e-42dd-9135-274797f74b5b None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:38.203381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 202/400] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Aug 23 16:25:37 2022] PUT /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4/groups/bbfa0adcdff2403786df4240ce4dd8e3/roles/1f86135571074da38ac7d898436a8862 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:25:38.206083 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6abec-e2dd-4e06-8cbc-f94f78a9f585 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:38.206083 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6abec-e2dd-4e06-8cbc-f94f78a9f585 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:38.206083 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6abec-e2dd-4e06-8cbc-f94f78a9f585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:38.244418 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-b1c6abec-e2dd-4e06-8cbc-f94f78a9f585 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:38.245970 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-b1c6abec-e2dd-4e06-8cbc-f94f78a9f585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:38.265588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:38.320320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800d7c8-563e-42dd-9135-274797f74b5b None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:38.348449 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 203/401] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:38.351846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6abec-e2dd-4e06-8cbc-f94f78a9f585 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:38.376268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207267d-a48e-4c50-b24e-8733806cc176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:38.378661 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207267d-a48e-4c50-b24e-8733806cc176 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:38.379146 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207267d-a48e-4c50-b24e-8733806cc176 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:38.379856 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207267d-a48e-4c50-b24e-8733806cc176 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:38.381479 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207267d-a48e-4c50-b24e-8733806cc176 None admin] RBAC: Adding query filter params (name=member) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:38.382102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207267d-a48e-4c50-b24e-8733806cc176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:38.383807 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207267d-a48e-4c50-b24e-8733806cc176 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:38.403211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 199/402] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:38.408745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207267d-a48e-4c50-b24e-8733806cc176 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:38.505873 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6abec-e2dd-4e06-8cbc-f94f78a9f585 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:38.508098 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:38.537907 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207267d-a48e-4c50-b24e-8733806cc176 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:38.546130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef6578-7415-4940-a72a-aada55140d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:38.547090 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef6578-7415-4940-a72a-aada55140d98 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:38.547674 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef6578-7415-4940-a72a-aada55140d98 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:38.548166 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef6578-7415-4940-a72a-aada55140d98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:38.557308 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:38.563597 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef6578-7415-4940-a72a-aada55140d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-40ef6578-7415-4940-a72a-aada55140d98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:38.568775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:38.569679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:38.570719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:38.570719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:38.570719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:38.570719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:38.570719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:38.570719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:38.570719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:38.570719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:38.570719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:38.570719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:38.570719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:38.570719 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:38.573685 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 204/403] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:25:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:38.577416 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ef46c-2912-44c0-b652-75249cb51fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:38.577416 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef46c-2912-44c0-b652-75249cb51fc9 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:38.577416 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef46c-2912-44c0-b652-75249cb51fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:38.577416 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef46c-2912-44c0-b652-75249cb51fc9 None admin] PATH_INFO: `/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:38.580188 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ef46c-2912-44c0-b652-75249cb51fc9 None admin] RBAC: Authorizing `identity:get_group(group_id=bbfa0adcdff2403786df4240ce4dd8e3)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:38.580899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef6578-7415-4940-a72a-aada55140d98 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:38.581879 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ef46c-2912-44c0-b652-75249cb51fc9 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:38.584033 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 200/404] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:38 2022] GET /identity/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:38.592786 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ef46c-2912-44c0-b652-75249cb51fc9 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:38.765023 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef6578-7415-4940-a72a-aada55140d98 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:38.803045 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ef46c-2912-44c0-b652-75249cb51fc9 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:38.806893 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c02592-afaf-4e51-b02a-d584a649289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:38.807036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c02592-afaf-4e51-b02a-d584a649289c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:38.807251 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c02592-afaf-4e51-b02a-d584a649289c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:38.807530 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c02592-afaf-4e51-b02a-d584a649289c None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:38.808188 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c02592-afaf-4e51-b02a-d584a649289c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:38.808492 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c02592-afaf-4e51-b02a-d584a649289c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:38.810073 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c02592-afaf-4e51-b02a-d584a649289c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:38.823591 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 205/405] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:38.823591 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c02592-afaf-4e51-b02a-d584a649289c None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:38.854462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:38.860355 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a156b1-bd26-4d96-997b-d9e97d44b863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:38.861458 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a156b1-bd26-4d96-997b-d9e97d44b863 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:38.862257 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a156b1-bd26-4d96-997b-d9e97d44b863 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:38.862996 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a156b1-bd26-4d96-997b-d9e97d44b863 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:38.864471 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a156b1-bd26-4d96-997b-d9e97d44b863 None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:38.865941 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a156b1-bd26-4d96-997b-d9e97d44b863 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:38.867884 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 201/406] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:38 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:38.868739 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a156b1-bd26-4d96-997b-d9e97d44b863 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:38.928977 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:38.945671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c02592-afaf-4e51-b02a-d584a649289c None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:38.983190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a156b1-bd26-4d96-997b-d9e97d44b863 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:38.984628 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100cac6-01d1-414a-ac5d-35cecf602977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:38.986600 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100cac6-01d1-414a-ac5d-35cecf602977 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:38.987091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100cac6-01d1-414a-ac5d-35cecf602977 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:38.987568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100cac6-01d1-414a-ac5d-35cecf602977 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:39.002553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100cac6-01d1-414a-ac5d-35cecf602977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-9100cac6-01d1-414a-ac5d-35cecf602977 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:39.010092 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:39.011003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:39.011902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:39.011902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:39.011902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:39.011902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:39.011902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:39.011902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:39.011902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:39.011902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:39.011902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:39.011902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:39.011902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:39.011902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:39.015361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 206/407] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:39.016387 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100cac6-01d1-414a-ac5d-35cecf602977 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:39.028579 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2381bab-f15b-4e7a-9a6e-3cdc102edbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:39.029226 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2381bab-f15b-4e7a-9a6e-3cdc102edbab None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:39.029505 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2381bab-f15b-4e7a-9a6e-3cdc102edbab None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:39.029778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2381bab-f15b-4e7a-9a6e-3cdc102edbab None admin] PATH_INFO: `/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:39.030987 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2381bab-f15b-4e7a-9a6e-3cdc102edbab None admin] RBAC: Authorizing `identity:get_group(group_id=bbfa0adcdff2403786df4240ce4dd8e3)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:39.032603 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2381bab-f15b-4e7a-9a6e-3cdc102edbab None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:39.038936 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 202/408] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:38 2022] GET /identity/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:39.040081 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2381bab-f15b-4e7a-9a6e-3cdc102edbab None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:39.130179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:39.149162 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100cac6-01d1-414a-ac5d-35cecf602977 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:39.159779 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2381bab-f15b-4e7a-9a6e-3cdc102edbab None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:39.180724 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:39.186984 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702de64c-9a9f-461b-9159-4b259ccb11a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:39.187964 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702de64c-9a9f-461b-9159-4b259ccb11a5 None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:39.188439 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702de64c-9a9f-461b-9159-4b259ccb11a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:39.189362 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702de64c-9a9f-461b-9159-4b259ccb11a5 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c/groups/bbfa0adcdff2403786df4240ce4dd8e3/roles/4bc1625db2f14e779d8acb4d21d9d3f1` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:39.191641 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702de64c-9a9f-461b-9159-4b259ccb11a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b3e0cdb32043e499f5197ea0bfea1c, group_id=bbfa0adcdff2403786df4240ce4dd8e3, role_id=4bc1625db2f14e779d8acb4d21d9d3f1)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:39.193304 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702de64c-9a9f-461b-9159-4b259ccb11a5 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:39.196130 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435d695-5094-40e8-bda8-d1a893625986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:39.196770 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435d695-5094-40e8-bda8-d1a893625986 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:39.197048 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435d695-5094-40e8-bda8-d1a893625986 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:39.197323 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435d695-5094-40e8-bda8-d1a893625986 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:39.198417 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435d695-5094-40e8-bda8-d1a893625986 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:39.198707 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435d695-5094-40e8-bda8-d1a893625986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:39.200795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435d695-5094-40e8-bda8-d1a893625986 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:39.210315 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 203/409] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:39.210951 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435d695-5094-40e8-bda8-d1a893625986 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:39.328059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 207/410] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Aug 23 16:25:39 2022] PUT /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c/groups/bbfa0adcdff2403786df4240ce4dd8e3/roles/4bc1625db2f14e779d8acb4d21d9d3f1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:25:39.328909 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702de64c-9a9f-461b-9159-4b259ccb11a5 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:39.332510 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435d695-5094-40e8-bda8-d1a893625986 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:39.388491 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6698d95-caad-4fd1-b010-fa6bd4edd650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:39.389878 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6698d95-caad-4fd1-b010-fa6bd4edd650 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:39.391508 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6698d95-caad-4fd1-b010-fa6bd4edd650 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:39.392073 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6698d95-caad-4fd1-b010-fa6bd4edd650 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:39.393734 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6698d95-caad-4fd1-b010-fa6bd4edd650 None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:39.395764 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6698d95-caad-4fd1-b010-fa6bd4edd650 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:39.404367 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 204/411] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:39 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:39.406729 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c896d-da80-4e7c-969c-1772023d8d62 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:39.409725 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c896d-da80-4e7c-969c-1772023d8d62 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:39.409725 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c896d-da80-4e7c-969c-1772023d8d62 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:39.409919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 205/412] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:39.413477 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c896d-da80-4e7c-969c-1772023d8d62 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:39.481341 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:39.497403 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702de64c-9a9f-461b-9159-4b259ccb11a5 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:39.541070 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c896d-da80-4e7c-969c-1772023d8d62 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:39.541404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c57cad-49e1-4521-bb1b-484bcd0869ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:39.542580 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c57cad-49e1-4521-bb1b-484bcd0869ae None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:39.542862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c57cad-49e1-4521-bb1b-484bcd0869ae None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:39.543132 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c57cad-49e1-4521-bb1b-484bcd0869ae None admin] PATH_INFO: `/v3/groups/844142de74804e45b2b87f7597e8a2d0` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:39.544442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c57cad-49e1-4521-bb1b-484bcd0869ae None admin] RBAC: Authorizing `identity:get_group(group_id=844142de74804e45b2b87f7597e8a2d0)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:39.545916 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c57cad-49e1-4521-bb1b-484bcd0869ae None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:39.547841 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 208/413] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:39 2022] GET /identity/v3/groups/844142de74804e45b2b87f7597e8a2d0 => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:39.549008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29378407-035b-4898-bbe8-425a30227258 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:39.549286 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29378407-035b-4898-bbe8-425a30227258 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:39.549564 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29378407-035b-4898-bbe8-425a30227258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:39.573554 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-29378407-035b-4898-bbe8-425a30227258 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:39.575329 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-29378407-035b-4898-bbe8-425a30227258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:39.583459 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:39.593054 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276c9aa-6af5-4ddd-a715-5ff571cc906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:39.598903 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276c9aa-6af5-4ddd-a715-5ff571cc906b None admin] REQUEST_METHOD: `PUT` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:39.598903 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276c9aa-6af5-4ddd-a715-5ff571cc906b None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:39.598903 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276c9aa-6af5-4ddd-a715-5ff571cc906b None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c/groups/bbfa0adcdff2403786df4240ce4dd8e3/roles/1f86135571074da38ac7d898436a8862` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:39.598903 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276c9aa-6af5-4ddd-a715-5ff571cc906b None admin] RBAC: Authorizing `identity:create_grant(project_id=40b3e0cdb32043e499f5197ea0bfea1c, group_id=bbfa0adcdff2403786df4240ce4dd8e3, role_id=1f86135571074da38ac7d898436a8862)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:39.598903 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276c9aa-6af5-4ddd-a715-5ff571cc906b None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:39.647778 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 209/414] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:39.651414 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29378407-035b-4898-bbe8-425a30227258 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:39.753174 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 206/415] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Aug 23 16:25:39 2022] PUT /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c/groups/bbfa0adcdff2403786df4240ce4dd8e3/roles/1f86135571074da38ac7d898436a8862 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:25:39.754647 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29378407-035b-4898-bbe8-425a30227258 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:39.797478 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebcb6b-b500-4d7e-9eaa-890f7101aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:39.798188 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebcb6b-b500-4d7e-9eaa-890f7101aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:39.798532 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebcb6b-b500-4d7e-9eaa-890f7101aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:39.798812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebcb6b-b500-4d7e-9eaa-890f7101aeb4 None admin] PATH_INFO: `/v3/projects/8f03f75490504c439981665b0cba53a2` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:39.800110 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebcb6b-b500-4d7e-9eaa-890f7101aeb4 None admin] RBAC: Authorizing `identity:get_project(project_id=8f03f75490504c439981665b0cba53a2)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:39.801574 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebcb6b-b500-4d7e-9eaa-890f7101aeb4 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:39.803470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 210/416] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:39 2022] GET /identity/v3/projects/8f03f75490504c439981665b0cba53a2 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:39.812638 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276c9aa-6af5-4ddd-a715-5ff571cc906b None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:39.976392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276c9aa-6af5-4ddd-a715-5ff571cc906b None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:39.992577 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:40.031906 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1c1aa-0541-4904-be43-dd9bfd03027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:40.032628 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1c1aa-0541-4904-be43-dd9bfd03027d None admin] REQUEST_METHOD: `PUT` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:40.032902 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1c1aa-0541-4904-be43-dd9bfd03027d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:40.033173 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1c1aa-0541-4904-be43-dd9bfd03027d None admin] PATH_INFO: `/v3/projects/8f03f75490504c439981665b0cba53a2/groups/844142de74804e45b2b87f7597e8a2d0/roles/091802a86e334e129210219b7c69359d` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:40.035150 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1c1aa-0541-4904-be43-dd9bfd03027d None admin] RBAC: Authorizing `identity:create_grant(project_id=8f03f75490504c439981665b0cba53a2, group_id=844142de74804e45b2b87f7597e8a2d0, role_id=091802a86e334e129210219b7c69359d)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:40.037921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1c1aa-0541-4904-be43-dd9bfd03027d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:40.099651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebcb6b-b500-4d7e-9eaa-890f7101aeb4 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:40.118495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:40.120557 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 207/417] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Aug 23 16:25:39 2022] PUT /identity/v3/projects/8f03f75490504c439981665b0cba53a2/groups/844142de74804e45b2b87f7597e8a2d0/roles/091802a86e334e129210219b7c69359d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:25:40.284724 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebcb6b-b500-4d7e-9eaa-890f7101aeb4 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:40.330398 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67dec0-321f-41c7-a1cb-d65e94257055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:40.331033 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67dec0-321f-41c7-a1cb-d65e94257055 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:40.331551 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67dec0-321f-41c7-a1cb-d65e94257055 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:40.331830 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67dec0-321f-41c7-a1cb-d65e94257055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:40.344211 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67dec0-321f-41c7-a1cb-d65e94257055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-0e67dec0-321f-41c7-a1cb-d65e94257055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:40.349191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:40.350129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:40.351831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:40.351831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:40.351831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:40.351831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:40.351831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:40.351831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:40.351831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:40.351831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:40.351831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:40.351831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:40.351831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:40.351831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:40.351831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 211/418] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:25:40.357319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1c1aa-0541-4904-be43-dd9bfd03027d None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:40.488872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1c1aa-0541-4904-be43-dd9bfd03027d None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:40.533833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0c397-ca40-456f-8297-1962ac1c38e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:40.534465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0c397-ca40-456f-8297-1962ac1c38e4 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:40.534797 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0c397-ca40-456f-8297-1962ac1c38e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:40.535017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0c397-ca40-456f-8297-1962ac1c38e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:40.535720 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0c397-ca40-456f-8297-1962ac1c38e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:40.536026 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0c397-ca40-456f-8297-1962ac1c38e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:40.537578 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0c397-ca40-456f-8297-1962ac1c38e4 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:40.551908 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 208/419] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:40.556409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67dec0-321f-41c7-a1cb-d65e94257055 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:40.650339 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:40.686010 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67dec0-321f-41c7-a1cb-d65e94257055 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:40.735760 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a299599-40e7-4eb2-a397-7781ab3d1e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:40.736532 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a299599-40e7-4eb2-a397-7781ab3d1e8b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:40.736890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a299599-40e7-4eb2-a397-7781ab3d1e8b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:40.737166 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a299599-40e7-4eb2-a397-7781ab3d1e8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:40.775263 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb96d69-9f11-45c1-a192-69eab2b7cb59 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:40.775559 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb96d69-9f11-45c1-a192-69eab2b7cb59 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:40.775840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb96d69-9f11-45c1-a192-69eab2b7cb59 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:40.777430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 209/420] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:40.784471 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca2dd6-958e-438f-9c09-7ce7117308ba None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:40.784787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca2dd6-958e-438f-9c09-7ce7117308ba None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:40.785124 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca2dd6-958e-438f-9c09-7ce7117308ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:40.806736 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-7eca2dd6-958e-438f-9c09-7ce7117308ba None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:40.808055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-7eca2dd6-958e-438f-9c09-7ce7117308ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:40.844026 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:40.890087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 210/421] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:40.901378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a299599-40e7-4eb2-a397-7781ab3d1e8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:40.902881 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a299599-40e7-4eb2-a397-7781ab3d1e8b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:41.020403 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:41.062222 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 212/422] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:41.066578 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca2dd6-958e-438f-9c09-7ce7117308ba None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:41.228300 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca2dd6-958e-438f-9c09-7ce7117308ba None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:41.281044 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22ab7c-fc3f-4be6-84b5-e524d0ec1073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:41.282052 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22ab7c-fc3f-4be6-84b5-e524d0ec1073 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:41.282528 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22ab7c-fc3f-4be6-84b5-e524d0ec1073 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:41.282994 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22ab7c-fc3f-4be6-84b5-e524d0ec1073 None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:41.284377 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22ab7c-fc3f-4be6-84b5-e524d0ec1073 None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:41.286038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22ab7c-fc3f-4be6-84b5-e524d0ec1073 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:41.287915 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 211/423] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:41 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:41.296328 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a299599-40e7-4eb2-a397-7781ab3d1e8b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:41.403573 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22ab7c-fc3f-4be6-84b5-e524d0ec1073 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:41.445950 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a299599-40e7-4eb2-a397-7781ab3d1e8b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:41.483349 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff3dd0-8a87-46cd-92ed-0955e0f139f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:41.483679 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:41.483998 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff3dd0-8a87-46cd-92ed-0955e0f139f2 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:41.484276 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff3dd0-8a87-46cd-92ed-0955e0f139f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:41.484552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff3dd0-8a87-46cd-92ed-0955e0f139f2 None admin] PATH_INFO: `/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:41.485696 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff3dd0-8a87-46cd-92ed-0955e0f139f2 None admin] RBAC: Authorizing `identity:get_group(group_id=bbfa0adcdff2403786df4240ce4dd8e3)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:41.487150 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff3dd0-8a87-46cd-92ed-0955e0f139f2 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:41.489185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 213/424] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:41 2022] GET /identity/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:41.495477 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff3dd0-8a87-46cd-92ed-0955e0f139f2 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:41.572619 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:41.607156 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22ab7c-fc3f-4be6-84b5-e524d0ec1073 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:41.675701 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fbde8-23e1-4d08-963f-fb7b971cfdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:41.676263 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fbde8-23e1-4d08-963f-fb7b971cfdcc None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:41.676533 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fbde8-23e1-4d08-963f-fb7b971cfdcc None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:41.676798 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fbde8-23e1-4d08-963f-fb7b971cfdcc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:41.692421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff3dd0-8a87-46cd-92ed-0955e0f139f2 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:41.698496 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fbde8-23e1-4d08-963f-fb7b971cfdcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-b61fbde8-23e1-4d08-963f-fb7b971cfdcc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:41.703403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:41.704283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:41.706210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:41.706210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:41.706210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:41.706210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:41.706210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:41.706210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:41.706210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:41.706210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:41.706210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:41.706210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:41.706210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:41.706210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:41.706210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 212/425] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:25:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:25:41.713854 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fbde8-23e1-4d08-963f-fb7b971cfdcc None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:41.781588 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc04130-ad3c-4e1b-a33d-f3e40eea2beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:41.782255 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc04130-ad3c-4e1b-a33d-f3e40eea2beb None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:41.782538 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc04130-ad3c-4e1b-a33d-f3e40eea2beb None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:41.782817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc04130-ad3c-4e1b-a33d-f3e40eea2beb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:41.784983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc04130-ad3c-4e1b-a33d-f3e40eea2beb None admin] RBAC: Adding query filter params (group.id=bbfa0adcdff2403786df4240ce4dd8e3, role.id=4bc1625db2f14e779d8acb4d21d9d3f1, scope.project.id=39c3c57ed064477baba507d8cda5eee4) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:41.785305 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc04130-ad3c-4e1b-a33d-f3e40eea2beb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:41.790201 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc04130-ad3c-4e1b-a33d-f3e40eea2beb None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:41.802658 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 214/426] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Aug 23 16:25:41 2022] GET /identity/v3/role_assignments?group.id=bbfa0adcdff2403786df4240ce4dd8e3&scope.project.id=39c3c57ed064477baba507d8cda5eee4&role.id=4bc1625db2f14e779d8acb4d21d9d3f1 => generated 611 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:41.867098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:41.881261 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fbde8-23e1-4d08-963f-fb7b971cfdcc None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:41.939032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c85820-f695-4000-90aa-ca9fd4bc47a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:41.939990 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c85820-f695-4000-90aa-ca9fd4bc47a7 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:41.940447 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c85820-f695-4000-90aa-ca9fd4bc47a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:41.940917 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c85820-f695-4000-90aa-ca9fd4bc47a7 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:41.941786 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c85820-f695-4000-90aa-ca9fd4bc47a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:41.942270 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c85820-f695-4000-90aa-ca9fd4bc47a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:41.943888 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c85820-f695-4000-90aa-ca9fd4bc47a7 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:41.959349 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 213/427] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:41.970078 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc04130-ad3c-4e1b-a33d-f3e40eea2beb None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:42.029114 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37429e7-26cb-43e7-a5d3-1ed5284c7d19 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:42.029696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37429e7-26cb-43e7-a5d3-1ed5284c7d19 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:42.030146 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37429e7-26cb-43e7-a5d3-1ed5284c7d19 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:42.032891 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 214/428] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:25:42.040105 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60de523-b538-4bf9-aac9-9bdada90886c None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:42.040649 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60de523-b538-4bf9-aac9-9bdada90886c None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:42.041093 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60de523-b538-4bf9-aac9-9bdada90886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:42.067773 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-c60de523-b538-4bf9-aac9-9bdada90886c None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:42.069313 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-c60de523-b538-4bf9-aac9-9bdada90886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:42.142574 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc04130-ad3c-4e1b-a33d-f3e40eea2beb None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:42.144474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:42.169396 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 215/429] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:42.196984 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3bbb0-cc34-4a11-9143-dd1ccf7d12be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:42.197512 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3bbb0-cc34-4a11-9143-dd1ccf7d12be None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:42.197793 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3bbb0-cc34-4a11-9143-dd1ccf7d12be None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:42.198072 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3bbb0-cc34-4a11-9143-dd1ccf7d12be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:42.288303 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3bbb0-cc34-4a11-9143-dd1ccf7d12be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:42.289825 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3bbb0-cc34-4a11-9143-dd1ccf7d12be None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:42.416682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fa9fa-2af8-46a5-b38a-65acdbb05bb6 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:42.417000 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fa9fa-2af8-46a5-b38a-65acdbb05bb6 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:42.417221 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fa9fa-2af8-46a5-b38a-65acdbb05bb6 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:42.418636 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 216/430] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:42.425900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 215/431] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:42.428693 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba49b4-fb48-4abd-8a84-71a1e50cc67a None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:42.428975 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba49b4-fb48-4abd-8a84-71a1e50cc67a None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:42.429776 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba49b4-fb48-4abd-8a84-71a1e50cc67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:42.431343 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3bbb0-cc34-4a11-9143-dd1ccf7d12be None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:42.434750 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:42.458310 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-2eba49b4-fb48-4abd-8a84-71a1e50cc67a None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:42.458310 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-2eba49b4-fb48-4abd-8a84-71a1e50cc67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:42.553439 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 217/432] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:42.572881 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3bbb0-cc34-4a11-9143-dd1ccf7d12be None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:42.598501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba49b4-fb48-4abd-8a84-71a1e50cc67a None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:42.612339 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be9039-1445-4212-86f1-551ff167de8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:42.613132 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be9039-1445-4212-86f1-551ff167de8b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:42.613415 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be9039-1445-4212-86f1-551ff167de8b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:42.613693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be9039-1445-4212-86f1-551ff167de8b None admin] PATH_INFO: `/v3/projects/39c3c57ed064477baba507d8cda5eee4` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:42.614853 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be9039-1445-4212-86f1-551ff167de8b None admin] RBAC: Authorizing `identity:get_project(project_id=39c3c57ed064477baba507d8cda5eee4)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:42.616487 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be9039-1445-4212-86f1-551ff167de8b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:42.618452 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 216/433] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:42 2022] GET /identity/v3/projects/39c3c57ed064477baba507d8cda5eee4 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:42.620180 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:42.624616 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be9039-1445-4212-86f1-551ff167de8b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:42.716448 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:42.732403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba49b4-fb48-4abd-8a84-71a1e50cc67a None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:42.770424 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be9039-1445-4212-86f1-551ff167de8b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:42.783776 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b92a6a-07b9-4b21-b23a-bb636a8bcefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:42.784711 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b92a6a-07b9-4b21-b23a-bb636a8bcefd None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:42.784996 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b92a6a-07b9-4b21-b23a-bb636a8bcefd None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:42.785274 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b92a6a-07b9-4b21-b23a-bb636a8bcefd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:42.800715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b92a6a-07b9-4b21-b23a-bb636a8bcefd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-31b92a6a-07b9-4b21-b23a-bb636a8bcefd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:42.807404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:42.808285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:42.810175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:42.810175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:42.810175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:42.810175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:42.810175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:42.810175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:42.810175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:42.810175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:42.810175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:42.810175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:42.810175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:25:42.810175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:42.810175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 218/434] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:42.813564 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f7383-c0e6-4f1c-9487-e01c06216c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:42.814225 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f7383-c0e6-4f1c-9487-e01c06216c09 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:42.814505 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f7383-c0e6-4f1c-9487-e01c06216c09 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:42.814780 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f7383-c0e6-4f1c-9487-e01c06216c09 None admin] PATH_INFO: `/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:42.815260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b92a6a-07b9-4b21-b23a-bb636a8bcefd None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:42.816478 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f7383-c0e6-4f1c-9487-e01c06216c09 None admin] RBAC: Authorizing `identity:get_group(group_id=bbfa0adcdff2403786df4240ce4dd8e3)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:42.817931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f7383-c0e6-4f1c-9487-e01c06216c09 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:42.819810 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 217/435] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:42 2022] GET /identity/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:42.829113 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f7383-c0e6-4f1c-9487-e01c06216c09 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:42.897097 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:42.931767 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b92a6a-07b9-4b21-b23a-bb636a8bcefd None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:42.960584 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f7383-c0e6-4f1c-9487-e01c06216c09 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:42.973397 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce45ccf-4ce8-4f9d-8e1d-e9732a6d2891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:42.974212 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce45ccf-4ce8-4f9d-8e1d-e9732a6d2891 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:42.974499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce45ccf-4ce8-4f9d-8e1d-e9732a6d2891 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:42.974774 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce45ccf-4ce8-4f9d-8e1d-e9732a6d2891 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:42.975628 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce45ccf-4ce8-4f9d-8e1d-e9732a6d2891 None admin] RBAC: Adding query filter params (name=member) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:42.975937 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce45ccf-4ce8-4f9d-8e1d-e9732a6d2891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:42.977718 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce45ccf-4ce8-4f9d-8e1d-e9732a6d2891 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:42.987097 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 219/436] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:25:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:42.987097 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce45ccf-4ce8-4f9d-8e1d-e9732a6d2891 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:43.008112 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae6bcf-e1eb-43ff-8e75-9e49dcc26314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:43.008730 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae6bcf-e1eb-43ff-8e75-9e49dcc26314 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:43.009006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae6bcf-e1eb-43ff-8e75-9e49dcc26314 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:43.009279 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae6bcf-e1eb-43ff-8e75-9e49dcc26314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:43.010008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae6bcf-e1eb-43ff-8e75-9e49dcc26314 None admin] RBAC: Adding query filter params (group.id=bbfa0adcdff2403786df4240ce4dd8e3, role.id=1f86135571074da38ac7d898436a8862, scope.project.id=39c3c57ed064477baba507d8cda5eee4) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:43.010311 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae6bcf-e1eb-43ff-8e75-9e49dcc26314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:43.011831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae6bcf-e1eb-43ff-8e75-9e49dcc26314 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:43.023336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 218/437] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Aug 23 16:25:42 2022] GET /identity/v3/role_assignments?group.id=bbfa0adcdff2403786df4240ce4dd8e3&scope.project.id=39c3c57ed064477baba507d8cda5eee4&role.id=1f86135571074da38ac7d898436a8862 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:43.023336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae6bcf-e1eb-43ff-8e75-9e49dcc26314 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:43.024535 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:43.119576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce45ccf-4ce8-4f9d-8e1d-e9732a6d2891 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:43.154210 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae6bcf-e1eb-43ff-8e75-9e49dcc26314 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:43.158621 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e2823-9e63-4220-9d6d-5d58f1d44f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:43.159394 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e2823-9e63-4220-9d6d-5d58f1d44f51 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:43.159747 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e2823-9e63-4220-9d6d-5d58f1d44f51 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:43.160095 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e2823-9e63-4220-9d6d-5d58f1d44f51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:43.165216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:43.183270 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e2823-9e63-4220-9d6d-5d58f1d44f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-c44e2823-9e63-4220-9d6d-5d58f1d44f51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:43.191828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:43.193065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:43.193887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:43.193887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:43.193887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:43.193887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:43.193887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:43.193887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:43.193887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:43.193887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:43.193887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:43.193887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:43.193887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:25:43.193887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:43.194590 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 220/438] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:25:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:43.200743 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e2823-9e63-4220-9d6d-5d58f1d44f51 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:43.205998 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f2869-1852-46fc-819f-696f3713cd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:43.206625 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f2869-1852-46fc-819f-696f3713cd32 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:43.206905 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f2869-1852-46fc-819f-696f3713cd32 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:43.207277 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f2869-1852-46fc-819f-696f3713cd32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:43.307722 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f2869-1852-46fc-819f-696f3713cd32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:43.309724 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f2869-1852-46fc-819f-696f3713cd32 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:43.312106 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:43.326524 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e2823-9e63-4220-9d6d-5d58f1d44f51 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:43.373233 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a93a63-08f7-403a-87be-a5dcf85d5c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:43.373862 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a93a63-08f7-403a-87be-a5dcf85d5c4b None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:43.374147 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a93a63-08f7-403a-87be-a5dcf85d5c4b None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:43.374419 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a93a63-08f7-403a-87be-a5dcf85d5c4b None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:43.375121 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a93a63-08f7-403a-87be-a5dcf85d5c4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:43.375490 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a93a63-08f7-403a-87be-a5dcf85d5c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:43.376880 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a93a63-08f7-403a-87be-a5dcf85d5c4b None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:43.386549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 221/439] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:43.387995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9dbe-3ad3-448c-8712-de108fe49dd0 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:43.388285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9dbe-3ad3-448c-8712-de108fe49dd0 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:43.388559 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9dbe-3ad3-448c-8712-de108fe49dd0 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:43.394210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 222/440] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:43.395565 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ff36d-067a-454b-b58c-f5258327d544 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:43.395856 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ff36d-067a-454b-b58c-f5258327d544 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:43.396133 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ff36d-067a-454b-b58c-f5258327d544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:43.417216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-d53ff36d-067a-454b-b58c-f5258327d544 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:43.418965 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-d53ff36d-067a-454b-b58c-f5258327d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:43.439689 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 219/441] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:43.440734 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f2869-1852-46fc-819f-696f3713cd32 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:43.477545 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:43.494665 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 223/442] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:43.495620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ff36d-067a-454b-b58c-f5258327d544 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:43.560171 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f2869-1852-46fc-819f-696f3713cd32 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:43.562515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:43.609406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b3794-e744-463b-890d-dafdbd439521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:43.610040 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b3794-e744-463b-890d-dafdbd439521 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:43.610378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b3794-e744-463b-890d-dafdbd439521 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:43.610743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b3794-e744-463b-890d-dafdbd439521 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:43.614086 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ff36d-067a-454b-b58c-f5258327d544 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:43.651722 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d023e-78fa-49be-81fd-3cb0755aa63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:43.652353 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d023e-78fa-49be-81fd-3cb0755aa63d None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:43.652663 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d023e-78fa-49be-81fd-3cb0755aa63d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:43.652934 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d023e-78fa-49be-81fd-3cb0755aa63d None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:43.654112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d023e-78fa-49be-81fd-3cb0755aa63d None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:43.655583 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d023e-78fa-49be-81fd-3cb0755aa63d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:43.657384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 224/443] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:43 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:43.662838 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d023e-78fa-49be-81fd-3cb0755aa63d None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:43.698933 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b3794-e744-463b-890d-dafdbd439521 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:43.699677 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b3794-e744-463b-890d-dafdbd439521 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:43.725680 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:43.777484 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d023e-78fa-49be-81fd-3cb0755aa63d None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:43.815796 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5695248-a99b-44a2-949c-50a1fe9740b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:43.816339 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5695248-a99b-44a2-949c-50a1fe9740b5 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:43.816621 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5695248-a99b-44a2-949c-50a1fe9740b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:43.816890 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5695248-a99b-44a2-949c-50a1fe9740b5 None admin] PATH_INFO: `/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:43.818007 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5695248-a99b-44a2-949c-50a1fe9740b5 None admin] RBAC: Authorizing `identity:get_group(group_id=bbfa0adcdff2403786df4240ce4dd8e3)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:43.819471 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5695248-a99b-44a2-949c-50a1fe9740b5 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:43.821379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 225/444] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:43 2022] GET /identity/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:43.823651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 220/445] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:43.828326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5695248-a99b-44a2-949c-50a1fe9740b5 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:43.829014 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b3794-e744-463b-890d-dafdbd439521 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:43.831129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:43.932169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5695248-a99b-44a2-949c-50a1fe9740b5 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:43.933130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b3794-e744-463b-890d-dafdbd439521 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:43.955194 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:43.968507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2469784-a7fb-4191-877c-344a01400b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:43.974181 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcc1f8-028c-4760-8a09-329acdb9de67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:43.974332 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2469784-a7fb-4191-877c-344a01400b24 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:43.974424 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcc1f8-028c-4760-8a09-329acdb9de67 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:43.974550 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2469784-a7fb-4191-877c-344a01400b24 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:43.974684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcc1f8-028c-4760-8a09-329acdb9de67 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:43.974795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2469784-a7fb-4191-877c-344a01400b24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:43.974924 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcc1f8-028c-4760-8a09-329acdb9de67 None admin] PATH_INFO: `/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:43.975025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2469784-a7fb-4191-877c-344a01400b24 None admin] RBAC: Adding query filter params (group.id=bbfa0adcdff2403786df4240ce4dd8e3, role.id=4bc1625db2f14e779d8acb4d21d9d3f1, scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:43.975025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2469784-a7fb-4191-877c-344a01400b24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:43.975186 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbcc1f8-028c-4760-8a09-329acdb9de67 None admin] RBAC: Authorizing `identity:get_project(project_id=40b3e0cdb32043e499f5197ea0bfea1c)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:43.975284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2469784-a7fb-4191-877c-344a01400b24 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:43.975355 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbcc1f8-028c-4760-8a09-329acdb9de67 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:43.975355 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 221/446] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:43 2022] GET /identity/v3/projects/40b3e0cdb32043e499f5197ea0bfea1c => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:43.976082 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcc1f8-028c-4760-8a09-329acdb9de67 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:43.979613 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 226/447] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Aug 23 16:25:43 2022] GET /identity/v3/role_assignments?group.id=bbfa0adcdff2403786df4240ce4dd8e3&scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c&role.id=4bc1625db2f14e779d8acb4d21d9d3f1 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:43.983633 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2469784-a7fb-4191-877c-344a01400b24 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:44.078258 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:44.111191 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2469784-a7fb-4191-877c-344a01400b24 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:44.112678 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcc1f8-028c-4760-8a09-329acdb9de67 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:44.155892 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23a3ca-e221-4465-98d2-656ef5c2dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:44.156537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23a3ca-e221-4465-98d2-656ef5c2dfa9 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:44.156810 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23a3ca-e221-4465-98d2-656ef5c2dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:44.157115 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23a3ca-e221-4465-98d2-656ef5c2dfa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:44.159747 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60ea7b-dcbc-4b27-b3e8-78e418a221e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:44.160779 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60ea7b-dcbc-4b27-b3e8-78e418a221e1 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:44.161109 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60ea7b-dcbc-4b27-b3e8-78e418a221e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:44.161389 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60ea7b-dcbc-4b27-b3e8-78e418a221e1 None admin] PATH_INFO: `/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:44.162696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60ea7b-dcbc-4b27-b3e8-78e418a221e1 None admin] RBAC: Authorizing `identity:get_group(group_id=bbfa0adcdff2403786df4240ce4dd8e3)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:44.164090 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60ea7b-dcbc-4b27-b3e8-78e418a221e1 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:44.166130 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 227/448] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:43 2022] GET /identity/v3/groups/bbfa0adcdff2403786df4240ce4dd8e3 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:44.172395 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60ea7b-dcbc-4b27-b3e8-78e418a221e1 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:44.173382 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23a3ca-e221-4465-98d2-656ef5c2dfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-8f23a3ca-e221-4465-98d2-656ef5c2dfa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:44.179138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:44.180117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:44.180918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:44.180918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:44.180918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:44.180918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:44.180918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:44.180918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:44.180918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:44.180918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:44.180918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:44.180918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:44.180918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:25:44.180918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:44.180918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 222/449] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:25:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:44.188528 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23a3ca-e221-4465-98d2-656ef5c2dfa9 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:44.243485 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:44.319070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23a3ca-e221-4465-98d2-656ef5c2dfa9 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:44.326091 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60ea7b-dcbc-4b27-b3e8-78e418a221e1 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:44.357452 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:44.368329 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2ac8e-e26c-43bc-ae0c-86c677464db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:44.369064 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2ac8e-e26c-43bc-ae0c-86c677464db1 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:44.369339 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2ac8e-e26c-43bc-ae0c-86c677464db1 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:44.369664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2ac8e-e26c-43bc-ae0c-86c677464db1 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:44.372844 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2ac8e-e26c-43bc-ae0c-86c677464db1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:44.372844 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2ac8e-e26c-43bc-ae0c-86c677464db1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:44.372844 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2ac8e-e26c-43bc-ae0c-86c677464db1 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:44.382174 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b1ef1-1aea-43c9-9e41-9e8df947a820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:44.382800 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b1ef1-1aea-43c9-9e41-9e8df947a820 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:44.384335 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b1ef1-1aea-43c9-9e41-9e8df947a820 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:44.384525 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 223/450] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:44.384666 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b1ef1-1aea-43c9-9e41-9e8df947a820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:44.384666 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b1ef1-1aea-43c9-9e41-9e8df947a820 None admin] RBAC: Adding query filter params (group.id=bbfa0adcdff2403786df4240ce4dd8e3, role.id=1f86135571074da38ac7d898436a8862, scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:44.384666 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b1ef1-1aea-43c9-9e41-9e8df947a820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:44.387402 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b1ef1-1aea-43c9-9e41-9e8df947a820 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:44.391462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2ac8e-e26c-43bc-ae0c-86c677464db1 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:44.394165 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 228/451] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Aug 23 16:25:44 2022] GET /identity/v3/role_assignments?group.id=bbfa0adcdff2403786df4240ce4dd8e3&scope.project.id=40b3e0cdb32043e499f5197ea0bfea1c&role.id=1f86135571074da38ac7d898436a8862 => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:44.524241 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2ac8e-e26c-43bc-ae0c-86c677464db1 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:44.561034 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e31b0-56cc-4b74-b10e-5318a1bb95c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:44.561717 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e31b0-56cc-4b74-b10e-5318a1bb95c8 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:44.561992 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e31b0-56cc-4b74-b10e-5318a1bb95c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:44.562262 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e31b0-56cc-4b74-b10e-5318a1bb95c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:44.622638 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:44.631622 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e31b0-56cc-4b74-b10e-5318a1bb95c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:44.633070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e31b0-56cc-4b74-b10e-5318a1bb95c8 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:44.733924 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 224/452] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:44.739724 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b1ef1-1aea-43c9-9e41-9e8df947a820 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:44.843528 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b1ef1-1aea-43c9-9e41-9e8df947a820 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:44.860578 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:44.877775 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc6bef-cc9c-4912-af5e-fa194e4ab78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:44.878335 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc6bef-cc9c-4912-af5e-fa194e4ab78c None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:44.878614 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc6bef-cc9c-4912-af5e-fa194e4ab78c None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:44.878888 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc6bef-cc9c-4912-af5e-fa194e4ab78c None admin] PATH_INFO: `/v3/projects/8f03f75490504c439981665b0cba53a2` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:44.880056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc6bef-cc9c-4912-af5e-fa194e4ab78c None admin] RBAC: Authorizing `identity:get_project(project_id=8f03f75490504c439981665b0cba53a2)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:44.881548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc6bef-cc9c-4912-af5e-fa194e4ab78c None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:44.883171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 229/453] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Aug 23 16:25:44 2022] GET /identity/v3/projects/8f03f75490504c439981665b0cba53a2 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:44.888892 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e31b0-56cc-4b74-b10e-5318a1bb95c8 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:44.975684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:44.984586 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e31b0-56cc-4b74-b10e-5318a1bb95c8 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:45.018457 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cc0fd-2504-46e5-a190-f7860b6b4d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:45.019070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cc0fd-2504-46e5-a190-f7860b6b4d9b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:45.019376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cc0fd-2504-46e5-a190-f7860b6b4d9b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:45.019648 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cc0fd-2504-46e5-a190-f7860b6b4d9b None admin] PATH_INFO: `/v3/groups/844142de74804e45b2b87f7597e8a2d0` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:45.020731 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cc0fd-2504-46e5-a190-f7860b6b4d9b None admin] RBAC: Authorizing `identity:get_group(group_id=844142de74804e45b2b87f7597e8a2d0)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:45.022151 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cc0fd-2504-46e5-a190-f7860b6b4d9b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:45.023981 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 225/454] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Aug 23 16:25:44 2022] GET /identity/v3/groups/844142de74804e45b2b87f7597e8a2d0 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:45.030021 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc6bef-cc9c-4912-af5e-fa194e4ab78c None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:45.125683 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc6bef-cc9c-4912-af5e-fa194e4ab78c None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:45.158142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f6bed-e287-49ed-af9f-e1ed03519ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:45.158665 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f6bed-e287-49ed-af9f-e1ed03519ed5 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:45.158945 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f6bed-e287-49ed-af9f-e1ed03519ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:45.159219 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f6bed-e287-49ed-af9f-e1ed03519ed5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:45.159968 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f6bed-e287-49ed-af9f-e1ed03519ed5 None admin] RBAC: Adding query filter params (group.id=844142de74804e45b2b87f7597e8a2d0, role.id=091802a86e334e129210219b7c69359d, scope.project.id=8f03f75490504c439981665b0cba53a2) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:45.160277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f6bed-e287-49ed-af9f-e1ed03519ed5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:45.161739 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f6bed-e287-49ed-af9f-e1ed03519ed5 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:45.167337 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 230/455] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Aug 23 16:25:45 2022] GET /identity/v3/role_assignments?group.id=844142de74804e45b2b87f7597e8a2d0&scope.project.id=8f03f75490504c439981665b0cba53a2&role.id=091802a86e334e129210219b7c69359d => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:47.688928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16ae79-fa7d-47b7-86b1-436f14385fd7 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:47.688928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16ae79-fa7d-47b7-86b1-436f14385fd7 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:47.688928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16ae79-fa7d-47b7-86b1-436f14385fd7 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:47.690010 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 226/456] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:47.695873 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416d175-8de3-4213-80a2-c7b3ef5253a2 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:47.696741 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416d175-8de3-4213-80a2-c7b3ef5253a2 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:47.697234 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416d175-8de3-4213-80a2-c7b3ef5253a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:47.716422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-7416d175-8de3-4213-80a2-c7b3ef5253a2 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:47.717929 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-7416d175-8de3-4213-80a2-c7b3ef5253a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:47.768472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:47.803365 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 231/457] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:47.948286 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48de15-d507-4739-bce0-a264e4028f2c None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:47.948487 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48de15-d507-4739-bce0-a264e4028f2c None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:47.949054 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48de15-d507-4739-bce0-a264e4028f2c None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:47.951413 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 227/458] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:47.957234 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a696027-fcb1-40a3-be25-9ea033e404df None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:47.957828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a696027-fcb1-40a3-be25-9ea033e404df None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:47.958310 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a696027-fcb1-40a3-be25-9ea033e404df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:47.985242 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-9a696027-fcb1-40a3-be25-9ea033e404df None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:47.988027 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-9a696027-fcb1-40a3-be25-9ea033e404df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:48.060446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45a3a1-a4a5-47f0-be81-7bdeafb75e59 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:48.061106 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45a3a1-a4a5-47f0-be81-7bdeafb75e59 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:48.061612 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45a3a1-a4a5-47f0-be81-7bdeafb75e59 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:48.067493 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 228/459] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:48.069047 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b997a95-1ce2-4d72-85f3-3b5d2a7888b7 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:48.069530 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b997a95-1ce2-4d72-85f3-3b5d2a7888b7 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:48.070006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b997a95-1ce2-4d72-85f3-3b5d2a7888b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:48.076563 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 232/460] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:48.091067 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-3b997a95-1ce2-4d72-85f3-3b5d2a7888b7 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:48.092971 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-3b997a95-1ce2-4d72-85f3-3b5d2a7888b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:48.171763 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 229/461] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:48.181060 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a696027-fcb1-40a3-be25-9ea033e404df None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:48.289796 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a696027-fcb1-40a3-be25-9ea033e404df None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:48.301645 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:48.327422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bce31-64b3-44e1-88f3-480f1f4e31a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:48.328064 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bce31-64b3-44e1-88f3-480f1f4e31a5 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:48.328343 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bce31-64b3-44e1-88f3-480f1f4e31a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:48.328641 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bce31-64b3-44e1-88f3-480f1f4e31a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:48.339444 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bce31-64b3-44e1-88f3-480f1f4e31a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:48.340969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bce31-64b3-44e1-88f3-480f1f4e31a5 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-a48bce31-64b3-44e1-88f3-480f1f4e31a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:48.357588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:48.358576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:48.359465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:48.359465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:48.359465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:48.363334 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 233/462] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:48.366249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b997a95-1ce2-4d72-85f3-3b5d2a7888b7 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:48.427612 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bce31-64b3-44e1-88f3-480f1f4e31a5 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:48.478835 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:48.491483 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b997a95-1ce2-4d72-85f3-3b5d2a7888b7 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:48.551589 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2e814-d7ed-42d2-b9fd-99f0a1a89f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:48.552274 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2e814-d7ed-42d2-b9fd-99f0a1a89f0b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:48.552623 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2e814-d7ed-42d2-b9fd-99f0a1a89f0b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:48.552899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2e814-d7ed-42d2-b9fd-99f0a1a89f0b None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:48.553565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2e814-d7ed-42d2-b9fd-99f0a1a89f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:48.553871 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2e814-d7ed-42d2-b9fd-99f0a1a89f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:48.555366 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2e814-d7ed-42d2-b9fd-99f0a1a89f0b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:48.563591 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bce31-64b3-44e1-88f3-480f1f4e31a5 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:48.580592 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 230/463] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:48.581567 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2e814-d7ed-42d2-b9fd-99f0a1a89f0b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:48.618114 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb59083-4090-44c3-94d4-fca27a1439ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:48.618837 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb59083-4090-44c3-94d4-fca27a1439ca None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:48.619116 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb59083-4090-44c3-94d4-fca27a1439ca None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:48.619437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb59083-4090-44c3-94d4-fca27a1439ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:48.634789 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb59083-4090-44c3-94d4-fca27a1439ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:48.639103 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb59083-4090-44c3-94d4-fca27a1439ca None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-dcb59083-4090-44c3-94d4-fca27a1439ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:48.655631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:48.656601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:48.657591 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:48.657591 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:48.657591 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:48.657591 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 234/464] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:25:48.657591 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb59083-4090-44c3-94d4-fca27a1439ca None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:48.676281 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:48.710916 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2e814-d7ed-42d2-b9fd-99f0a1a89f0b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:48.751261 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe397bb4-7909-47fc-a4cb-715e02041754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:48.751926 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe397bb4-7909-47fc-a4cb-715e02041754 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:48.752206 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe397bb4-7909-47fc-a4cb-715e02041754 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:48.752478 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe397bb4-7909-47fc-a4cb-715e02041754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:48.769200 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe397bb4-7909-47fc-a4cb-715e02041754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:48.770599 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe397bb4-7909-47fc-a4cb-715e02041754 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:48.785715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb59083-4090-44c3-94d4-fca27a1439ca None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-fe397bb4-7909-47fc-a4cb-715e02041754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:48.786521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:48.788164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:48.790007 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:48.790007 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:48.790007 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:48.790007 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 231/465] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:48.790007 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe397bb4-7909-47fc-a4cb-715e02041754 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:48.795316 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:48.828716 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397decf2-5fca-4ffa-8ca1-28da5cdc3fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:48.829233 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397decf2-5fca-4ffa-8ca1-28da5cdc3fbf None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:48.829511 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397decf2-5fca-4ffa-8ca1-28da5cdc3fbf None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:48.829780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397decf2-5fca-4ffa-8ca1-28da5cdc3fbf None admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:48.830417 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397decf2-5fca-4ffa-8ca1-28da5cdc3fbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:48.831891 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397decf2-5fca-4ffa-8ca1-28da5cdc3fbf None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:48.895649 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe397bb4-7909-47fc-a4cb-715e02041754 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:48.929391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e9ccc-46a4-42dc-b773-27caf9b24485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:48.930003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e9ccc-46a4-42dc-b773-27caf9b24485 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:48.930284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e9ccc-46a4-42dc-b773-27caf9b24485 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:48.930556 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e9ccc-46a4-42dc-b773-27caf9b24485 None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:48.931193 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e9ccc-46a4-42dc-b773-27caf9b24485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:48.931607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e9ccc-46a4-42dc-b773-27caf9b24485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:48.933012 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e9ccc-46a4-42dc-b773-27caf9b24485 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:48.939131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 235/466] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Aug 23 16:25:48 2022] POST /identity/v3/users => generated 246 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:25:48.940421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bb20f-4ea2-4a9b-8043-8447818894b7 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:48.943067 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bb20f-4ea2-4a9b-8043-8447818894b7 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:48.943067 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bb20f-4ea2-4a9b-8043-8447818894b7 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:48.943067 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 236/467] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:48.943067 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bb20f-4ea2-4a9b-8043-8447818894b7 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:48.951059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 232/468] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:48.952456 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2663ac9-d13b-4405-ae1a-34ac4fd3fb29 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:48.952745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2663ac9-d13b-4405-ae1a-34ac4fd3fb29 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:48.953026 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2663ac9-d13b-4405-ae1a-34ac4fd3fb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:48.973731 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-a2663ac9-d13b-4405-ae1a-34ac4fd3fb29 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:48.974994 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-a2663ac9-d13b-4405-ae1a-34ac4fd3fb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:49.052694 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:49.063407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:49.071507 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 233/469] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:49.072952 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2663ac9-d13b-4405-ae1a-34ac4fd3fb29 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:49.118886 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bb20f-4ea2-4a9b-8043-8447818894b7 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:49.162875 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d8496-9524-44bb-b678-333511672640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:49.163623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d8496-9524-44bb-b678-333511672640 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:49.163904 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d8496-9524-44bb-b678-333511672640 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:49.164180 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d8496-9524-44bb-b678-333511672640 None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:49.165304 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d8496-9524-44bb-b678-333511672640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:49.165304 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d8496-9524-44bb-b678-333511672640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:49.166896 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d8496-9524-44bb-b678-333511672640 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:49.185283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 237/470] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:49.191198 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d8496-9524-44bb-b678-333511672640 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:49.255116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2663ac9-d13b-4405-ae1a-34ac4fd3fb29 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:49.296711 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977b2f4-767b-44e9-a6f9-d4d3cf93bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:49.297386 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b2f4-767b-44e9-a6f9-d4d3cf93bf5f None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:49.297673 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b2f4-767b-44e9-a6f9-d4d3cf93bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:49.297943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b2f4-767b-44e9-a6f9-d4d3cf93bf5f None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:49.298967 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977b2f4-767b-44e9-a6f9-d4d3cf93bf5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:49.301082 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977b2f4-767b-44e9-a6f9-d4d3cf93bf5f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:49.325630 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d8496-9524-44bb-b678-333511672640 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:49.367432 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:49.374102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71a321-5260-4641-a631-eda5a45d4673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:49.374645 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71a321-5260-4641-a631-eda5a45d4673 None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:49.374938 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71a321-5260-4641-a631-eda5a45d4673 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:49.375204 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71a321-5260-4641-a631-eda5a45d4673 None admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:49.375898 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71a321-5260-4641-a631-eda5a45d4673 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:49.377591 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71a321-5260-4641-a631-eda5a45d4673 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:49.424492 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 234/471] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Aug 23 16:25:49 2022] POST /identity/v3/users => generated 248 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:25:49.425416 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977b2f4-767b-44e9-a6f9-d4d3cf93bf5f None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:49.487753 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:49.539257 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 238/472] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Aug 23 16:25:49 2022] POST /identity/v3/users => generated 248 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:25:49.562957 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977b2f4-767b-44e9-a6f9-d4d3cf93bf5f None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:49.605782 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fe7e3-016a-4adb-90cd-531c34fd0cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:49.606509 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fe7e3-016a-4adb-90cd-531c34fd0cc3 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:49.606792 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fe7e3-016a-4adb-90cd-531c34fd0cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:49.607071 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fe7e3-016a-4adb-90cd-531c34fd0cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:49.622158 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fe7e3-016a-4adb-90cd-531c34fd0cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:49.623788 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fe7e3-016a-4adb-90cd-531c34fd0cc3 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-f23fe7e3-016a-4adb-90cd-531c34fd0cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:49.641890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:49.642958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:49.643922 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:49.643922 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:49.643922 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:49.643922 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 235/473] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:49.649927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71a321-5260-4641-a631-eda5a45d4673 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:49.777194 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71a321-5260-4641-a631-eda5a45d4673 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:49.814158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d7f78-44f9-44c6-a6bb-bd2c45720280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:49.815491 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d7f78-44f9-44c6-a6bb-bd2c45720280 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:49.815913 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d7f78-44f9-44c6-a6bb-bd2c45720280 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:49.816346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d7f78-44f9-44c6-a6bb-bd2c45720280 None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:49.817189 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d7f78-44f9-44c6-a6bb-bd2c45720280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:49.817637 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d7f78-44f9-44c6-a6bb-bd2c45720280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:49.819184 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d7f78-44f9-44c6-a6bb-bd2c45720280 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:49.833601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 239/474] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:49.839535 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fe7e3-016a-4adb-90cd-531c34fd0cc3 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:49.953991 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:49.957006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fe7e3-016a-4adb-90cd-531c34fd0cc3 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:49.997825 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e804d-e4f0-4bc3-b8d0-f10e93e99d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:49.998789 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e804d-e4f0-4bc3-b8d0-f10e93e99d7e None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:49.999283 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e804d-e4f0-4bc3-b8d0-f10e93e99d7e None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:49.999832 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e804d-e4f0-4bc3-b8d0-f10e93e99d7e None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:50.001167 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e804d-e4f0-4bc3-b8d0-f10e93e99d7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:50.002893 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e804d-e4f0-4bc3-b8d0-f10e93e99d7e None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:50.081190 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 236/475] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Aug 23 16:25:49 2022] POST /identity/v3/users => generated 249 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:25:51.452053 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aecb45-9470-40fe-8019-462d07b6003e None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:51.453098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aecb45-9470-40fe-8019-462d07b6003e None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:51.453572 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aecb45-9470-40fe-8019-462d07b6003e None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:51.455366 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 240/476] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:51.460628 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b05f1a-e69c-4434-b12e-b2c2d6154c7d None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:51.461475 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b05f1a-e69c-4434-b12e-b2c2d6154c7d None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:51.461998 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b05f1a-e69c-4434-b12e-b2c2d6154c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:51.482315 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-a1b05f1a-e69c-4434-b12e-b2c2d6154c7d None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:51.483922 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-a1b05f1a-e69c-4434-b12e-b2c2d6154c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:51.557300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 237/477] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:51.814878 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289be1e2-9a09-4872-866f-180d56302847 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:51.815834 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289be1e2-9a09-4872-866f-180d56302847 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:51.815834 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289be1e2-9a09-4872-866f-180d56302847 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:51.817581 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 241/478] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:25:51.823398 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3601f12-15b4-4034-9580-028696baa088 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:51.824021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3601f12-15b4-4034-9580-028696baa088 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:51.824541 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3601f12-15b4-4034-9580-028696baa088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:51.843584 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-a3601f12-15b4-4034-9580-028696baa088 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:51.845183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-a3601f12-15b4-4034-9580-028696baa088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:51.902945 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289be1e2-9a09-4872-866f-180d56302847 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:51.920584 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 238/479] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:51.924646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc7128-3dec-461d-9004-461bbbdcb66f None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:51.925057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc7128-3dec-461d-9004-461bbbdcb66f None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:51.925343 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc7128-3dec-461d-9004-461bbbdcb66f None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:51.926865 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 239/480] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:25:51.931996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6dd5-013f-42c0-815f-816abed987b2 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:51.932590 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6dd5-013f-42c0-815f-816abed987b2 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:51.933005 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6dd5-013f-42c0-815f-816abed987b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:51.953551 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-a92a6dd5-013f-42c0-815f-816abed987b2 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:51.954976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-a92a6dd5-013f-42c0-815f-816abed987b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:51.961653 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:51.971595 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:52.035627 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289be1e2-9a09-4872-866f-180d56302847 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:52.039612 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 240/481] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:52.068293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71a33a-32d1-481e-a567-983463470b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:52.068982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71a33a-32d1-481e-a567-983463470b73 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:52.069253 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71a33a-32d1-481e-a567-983463470b73 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:52.069556 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71a33a-32d1-481e-a567-983463470b73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:52.081324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71a33a-32d1-481e-a567-983463470b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-8e71a33a-32d1-481e-a567-983463470b73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:52.086154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:52.094106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:52.095108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:52.095108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:52.095108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:52.095108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:52.095108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:52.095108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:52.095108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:52.095108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:52.095108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:52.095108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:52.095108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:52.095108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:52.095108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 242/482] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:25:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:52.096052 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a6dd5-013f-42c0-815f-816abed987b2 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:52.213842 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a6dd5-013f-42c0-815f-816abed987b2 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:52.254240 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041fbe6-5b63-4ebe-b280-c5fb2a6a8b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:52.254869 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041fbe6-5b63-4ebe-b280-c5fb2a6a8b28 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:52.255151 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041fbe6-5b63-4ebe-b280-c5fb2a6a8b28 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:52.255461 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041fbe6-5b63-4ebe-b280-c5fb2a6a8b28 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:52.256185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041fbe6-5b63-4ebe-b280-c5fb2a6a8b28 None admin] RBAC: Adding query filter params (name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:52.256496 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041fbe6-5b63-4ebe-b280-c5fb2a6a8b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:52.258033 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041fbe6-5b63-4ebe-b280-c5fb2a6a8b28 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:52.268071 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 241/483] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:25:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:52.271770 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71a33a-32d1-481e-a567-983463470b73 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:52.276405 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041fbe6-5b63-4ebe-b280-c5fb2a6a8b28 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:52.311746 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:52.392088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041fbe6-5b63-4ebe-b280-c5fb2a6a8b28 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:52.400480 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71a33a-32d1-481e-a567-983463470b73 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:52.409602 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:52.431666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb6975-7345-43b8-9bc4-b97b3d6f0227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:52.432308 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb6975-7345-43b8-9bc4-b97b3d6f0227 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:52.432587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb6975-7345-43b8-9bc4-b97b3d6f0227 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:52.432863 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb6975-7345-43b8-9bc4-b97b3d6f0227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:52.439218 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9348a-e78d-4a20-b0fd-dccb33d97521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:52.439945 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9348a-e78d-4a20-b0fd-dccb33d97521 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:52.440219 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9348a-e78d-4a20-b0fd-dccb33d97521 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:52.440492 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9348a-e78d-4a20-b0fd-dccb33d97521 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:52.446083 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb6975-7345-43b8-9bc4-b97b3d6f0227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:52.447608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb6975-7345-43b8-9bc4-b97b3d6f0227 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:52.455170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9348a-e78d-4a20-b0fd-dccb33d97521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-6ba9348a-e78d-4a20-b0fd-dccb33d97521 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:52.460488 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:52.461410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:52.462272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:52.462272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:52.462272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:52.462272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:52.462272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:52.462272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:52.462272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:52.462272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:52.462272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:52.462272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:52.462272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:52.462272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:52.463287 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 243/484] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:25:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:52.464325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9348a-e78d-4a20-b0fd-dccb33d97521 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-b0eb6975-7345-43b8-9bc4-b97b3d6f0227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:52.465290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:52.466714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:52.467834 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:52.467834 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:52.467834 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:52.467834 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 242/485] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:52.468416 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941c36e-e052-4d7a-90ef-169ce56b0385 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:52.468645 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941c36e-e052-4d7a-90ef-169ce56b0385 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:52.468924 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941c36e-e052-4d7a-90ef-169ce56b0385 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:52.470464 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 243/486] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:52.471627 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941c36e-e052-4d7a-90ef-169ce56b0385 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:52.537165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:52.572123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9348a-e78d-4a20-b0fd-dccb33d97521 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:52.581006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941c36e-e052-4d7a-90ef-169ce56b0385 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:52.608395 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8626ec-ddfd-4331-86cf-f85c20a616b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:52.609273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8626ec-ddfd-4331-86cf-f85c20a616b5 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:52.609686 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8626ec-ddfd-4331-86cf-f85c20a616b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:52.610097 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8626ec-ddfd-4331-86cf-f85c20a616b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:52.616520 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92729e02-7750-49ab-ab0a-97d1d39a78e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:52.617125 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92729e02-7750-49ab-ab0a-97d1d39a78e1 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:52.617410 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92729e02-7750-49ab-ab0a-97d1d39a78e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:52.617684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92729e02-7750-49ab-ab0a-97d1d39a78e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:52.618341 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92729e02-7750-49ab-ab0a-97d1d39a78e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:52.618644 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92729e02-7750-49ab-ab0a-97d1d39a78e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:52.620049 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92729e02-7750-49ab-ab0a-97d1d39a78e1 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:52.620832 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8626ec-ddfd-4331-86cf-f85c20a616b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-dd8626ec-ddfd-4331-86cf-f85c20a616b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:52.626082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:52.633999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 244/487] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:25:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:52.635024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8626ec-ddfd-4331-86cf-f85c20a616b5 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:52.635978 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 244/488] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:25:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:52.635978 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fbdc2-b347-4955-a2af-898e203f2540 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:52.635978 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fbdc2-b347-4955-a2af-898e203f2540 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:52.635978 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fbdc2-b347-4955-a2af-898e203f2540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:52.652629 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-d24fbdc2-b347-4955-a2af-898e203f2540 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:52.653825 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-d24fbdc2-b347-4955-a2af-898e203f2540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:52.663361 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:52.721852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 245/489] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:52.722703 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fbdc2-b347-4955-a2af-898e203f2540 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:52.794110 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:52.804064 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8626ec-ddfd-4331-86cf-f85c20a616b5 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:52.842750 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ccab7-ac6d-4a27-a6b2-b864841d054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:52.842750 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ccab7-ac6d-4a27-a6b2-b864841d054c None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:52.842750 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ccab7-ac6d-4a27-a6b2-b864841d054c None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:52.842750 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ccab7-ac6d-4a27-a6b2-b864841d054c None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:52.843462 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ccab7-ac6d-4a27-a6b2-b864841d054c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:52.843462 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ccab7-ac6d-4a27-a6b2-b864841d054c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:52.844799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ccab7-ac6d-4a27-a6b2-b864841d054c None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:52.851804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fbdc2-b347-4955-a2af-898e203f2540 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:52.856759 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 245/490] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:52.857795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ccab7-ac6d-4a27-a6b2-b864841d054c None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:52.896693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fffdc-340a-4109-bbce-f52475dcc5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:52.897469 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fffdc-340a-4109-bbce-f52475dcc5b5 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:52.898006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fffdc-340a-4109-bbce-f52475dcc5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:52.898283 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fffdc-340a-4109-bbce-f52475dcc5b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:52.909705 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fffdc-340a-4109-bbce-f52475dcc5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:52.911174 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fffdc-340a-4109-bbce-f52475dcc5b5 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-f73fffdc-340a-4109-bbce-f52475dcc5b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:52.927804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:52.928838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:52.929693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:52.929693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:52.929693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:52.929693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 246/491] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:52.929693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fffdc-340a-4109-bbce-f52475dcc5b5 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:52.955766 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:52.972328 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ccab7-ac6d-4a27-a6b2-b864841d054c None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:53.009708 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc6d7d-ef07-41b2-bcd9-98f2a0eace8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:53.010326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc6d7d-ef07-41b2-bcd9-98f2a0eace8d None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:53.010669 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc6d7d-ef07-41b2-bcd9-98f2a0eace8d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:53.010912 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc6d7d-ef07-41b2-bcd9-98f2a0eace8d None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:53.012151 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc6d7d-ef07-41b2-bcd9-98f2a0eace8d None admin] RBAC: Adding query filter params (name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:53.012458 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc6d7d-ef07-41b2-bcd9-98f2a0eace8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:53.013851 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc6d7d-ef07-41b2-bcd9-98f2a0eace8d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:53.027182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 246/492] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:25:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:53.027182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc6d7d-ef07-41b2-bcd9-98f2a0eace8d None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:53.045433 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fffdc-340a-4109-bbce-f52475dcc5b5 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:53.048889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:53.081709 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6964995-2ca3-424e-8593-31e0e7c1b256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:53.082358 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6964995-2ca3-424e-8593-31e0e7c1b256 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:53.082643 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6964995-2ca3-424e-8593-31e0e7c1b256 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:53.082919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6964995-2ca3-424e-8593-31e0e7c1b256 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:53.091932 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6964995-2ca3-424e-8593-31e0e7c1b256 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:53.093456 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6964995-2ca3-424e-8593-31e0e7c1b256 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-d6964995-2ca3-424e-8593-31e0e7c1b256 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:25:53.107282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:53.108282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:53.109179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:53.109179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:53.109179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:25:53.109179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:25:53.109179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:25:53.109179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:25:53.109179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:25:53.109179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:25:53.109179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:25:53.109179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:53.109179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 247/493] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Aug 23 16:25:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:53.109732 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6964995-2ca3-424e-8593-31e0e7c1b256 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:53.138506 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc6d7d-ef07-41b2-bcd9-98f2a0eace8d None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:53.172344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7915cb4-282b-4696-81a6-291572fc9e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:53.172953 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7915cb4-282b-4696-81a6-291572fc9e64 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:53.173237 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7915cb4-282b-4696-81a6-291572fc9e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:53.173505 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7915cb4-282b-4696-81a6-291572fc9e64 None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:53.174134 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7915cb4-282b-4696-81a6-291572fc9e64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:53.174434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7915cb4-282b-4696-81a6-291572fc9e64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:53.175829 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7915cb4-282b-4696-81a6-291572fc9e64 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:53.189701 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 247/494] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:53.190470 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7915cb4-282b-4696-81a6-291572fc9e64 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:53.204658 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:53.218319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6964995-2ca3-424e-8593-31e0e7c1b256 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:53.253481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07b728-1369-456c-ae21-294002b3b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:53.254105 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07b728-1369-456c-ae21-294002b3b70f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:53.254381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07b728-1369-456c-ae21-294002b3b70f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:53.254665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07b728-1369-456c-ae21-294002b3b70f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:53.266647 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07b728-1369-456c-ae21-294002b3b70f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:53.268161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07b728-1369-456c-ae21-294002b3b70f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-0e07b728-1369-456c-ae21-294002b3b70f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:53.282940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:53.283996 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:53.285550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:53.285550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:53.285550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:53.285550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 248/495] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:53.285550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07b728-1369-456c-ae21-294002b3b70f None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:53.301945 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7915cb4-282b-4696-81a6-291572fc9e64 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:53.304111 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:53.337689 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f469f-061a-4799-8578-0272cf6f7ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:53.338317 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f469f-061a-4799-8578-0272cf6f7ba6 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:53.338595 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f469f-061a-4799-8578-0272cf6f7ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:53.338865 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f469f-061a-4799-8578-0272cf6f7ba6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:53.351911 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f469f-061a-4799-8578-0272cf6f7ba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-d05f469f-061a-4799-8578-0272cf6f7ba6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:53.354544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:53.356131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:53.357143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:53.357143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:53.357143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:53.357143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:53.357143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:53.357143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:53.357143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:53.357143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:53.357143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:53.357143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:53.357143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:53.357143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:53.361173 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 248/496] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:25:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:53.361831 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f469f-061a-4799-8578-0272cf6f7ba6 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:53.400061 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07b728-1369-456c-ae21-294002b3b70f None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:53.437718 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:53.440549 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87299c2b-82e5-47d2-b8f7-7cce1b62105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:53.441158 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87299c2b-82e5-47d2-b8f7-7cce1b62105b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:53.441435 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87299c2b-82e5-47d2-b8f7-7cce1b62105b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:53.441707 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87299c2b-82e5-47d2-b8f7-7cce1b62105b None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:53.442431 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87299c2b-82e5-47d2-b8f7-7cce1b62105b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:53.442760 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87299c2b-82e5-47d2-b8f7-7cce1b62105b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:53.444209 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87299c2b-82e5-47d2-b8f7-7cce1b62105b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:53.473153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f469f-061a-4799-8578-0272cf6f7ba6 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:53.482477 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 249/497] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Aug 23 16:25:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:53.483368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87299c2b-82e5-47d2-b8f7-7cce1b62105b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:53.509367 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a7de-7aba-4bb0-a538-4ff977bd2909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:53.510174 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a7de-7aba-4bb0-a538-4ff977bd2909 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:53.510555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a7de-7aba-4bb0-a538-4ff977bd2909 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:53.510922 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a7de-7aba-4bb0-a538-4ff977bd2909 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:53.521131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205a7de-7aba-4bb0-a538-4ff977bd2909 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:53.523849 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205a7de-7aba-4bb0-a538-4ff977bd2909 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-3205a7de-7aba-4bb0-a538-4ff977bd2909 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:25:53.541061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:53.542107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:53.544320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:53.544320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:53.544320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:25:53.544320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:25:53.544320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:25:53.544320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:25:53.544320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:25:53.544320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:25:53.544320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:25:53.544320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:53.544320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 249/498] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:53.544320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a7de-7aba-4bb0-a538-4ff977bd2909 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:53.571982 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:53.596222 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87299c2b-82e5-47d2-b8f7-7cce1b62105b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:53.631166 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae78c9e-7d80-4959-a755-809b852ff30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:53.631723 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae78c9e-7d80-4959-a755-809b852ff30c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:53.632000 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae78c9e-7d80-4959-a755-809b852ff30c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:53.632274 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae78c9e-7d80-4959-a755-809b852ff30c None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:53.632932 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae78c9e-7d80-4959-a755-809b852ff30c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:53.633224 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae78c9e-7d80-4959-a755-809b852ff30c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:53.634677 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae78c9e-7d80-4959-a755-809b852ff30c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:53.645848 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 250/499] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:53.645994 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a7de-7aba-4bb0-a538-4ff977bd2909 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:53.646753 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae78c9e-7d80-4959-a755-809b852ff30c None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:53.674202 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:53.682486 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aecefd-f8c5-4dac-9a62-52b18e1163d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:53.683266 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aecefd-f8c5-4dac-9a62-52b18e1163d9 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:53.683556 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aecefd-f8c5-4dac-9a62-52b18e1163d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:53.683857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aecefd-f8c5-4dac-9a62-52b18e1163d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:53.684509 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aecefd-f8c5-4dac-9a62-52b18e1163d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:53.689659 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aecefd-f8c5-4dac-9a62-52b18e1163d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:53.689659 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aecefd-f8c5-4dac-9a62-52b18e1163d9 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:53.694780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 250/500] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:25:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:53.695642 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aecefd-f8c5-4dac-9a62-52b18e1163d9 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:53.756582 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae78c9e-7d80-4959-a755-809b852ff30c None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:53.796160 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41465af1-147a-4e9c-b799-310cdde2cf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:53.796758 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41465af1-147a-4e9c-b799-310cdde2cf84 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:53.797195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41465af1-147a-4e9c-b799-310cdde2cf84 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:53.797465 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41465af1-147a-4e9c-b799-310cdde2cf84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:53.800210 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:53.813603 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aecefd-f8c5-4dac-9a62-52b18e1163d9 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:53.847893 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f94ff5-843e-41ce-a868-c7aa2fb51db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:53.848494 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f94ff5-843e-41ce-a868-c7aa2fb51db0 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:53.848766 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f94ff5-843e-41ce-a868-c7aa2fb51db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:53.849039 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f94ff5-843e-41ce-a868-c7aa2fb51db0 None admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:53.849762 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f94ff5-843e-41ce-a868-c7aa2fb51db0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:53.850065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f94ff5-843e-41ce-a868-c7aa2fb51db0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:53.851608 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f94ff5-843e-41ce-a868-c7aa2fb51db0 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:53.865482 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41465af1-147a-4e9c-b799-310cdde2cf84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:53.866929 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41465af1-147a-4e9c-b799-310cdde2cf84 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:53.889924 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 251/501] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Aug 23 16:25:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:53.890701 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f94ff5-843e-41ce-a868-c7aa2fb51db0 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:53.943373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:53.966812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 251/502] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:53.967698 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41465af1-147a-4e9c-b799-310cdde2cf84 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:53.997538 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f94ff5-843e-41ce-a868-c7aa2fb51db0 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:54.000990 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:54.035003 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777e3c4-5e16-44d6-a22d-b065d19e9597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:54.035685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777e3c4-5e16-44d6-a22d-b065d19e9597 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:54.035959 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777e3c4-5e16-44d6-a22d-b065d19e9597 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:54.036254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777e3c4-5e16-44d6-a22d-b065d19e9597 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:54.043475 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777e3c4-5e16-44d6-a22d-b065d19e9597 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:54.044992 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777e3c4-5e16-44d6-a22d-b065d19e9597 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-9777e3c4-5e16-44d6-a22d-b065d19e9597 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:25:54.056620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:54.057625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:54.059309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:54.059309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:54.059309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:25:54.059309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:25:54.059309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:25:54.059309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:25:54.059309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:25:54.059309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:25:54.059309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:25:54.059309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:54.059309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 252/503] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:25:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:54.059309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777e3c4-5e16-44d6-a22d-b065d19e9597 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:54.071885 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41465af1-147a-4e9c-b799-310cdde2cf84 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:54.106464 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786c456-d41c-4d07-888c-d6ed4391b2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:54.107081 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786c456-d41c-4d07-888c-d6ed4391b2bc None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:54.107464 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786c456-d41c-4d07-888c-d6ed4391b2bc None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:54.107739 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786c456-d41c-4d07-888c-d6ed4391b2bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:54.117706 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786c456-d41c-4d07-888c-d6ed4391b2bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:54.119160 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786c456-d41c-4d07-888c-d6ed4391b2bc None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-d786c456-d41c-4d07-888c-d6ed4391b2bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:54.133481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:54.134605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:54.135489 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:54.135489 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:54.135489 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:54.135489 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 252/504] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:54.135801 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786c456-d41c-4d07-888c-d6ed4391b2bc None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:54.191574 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777e3c4-5e16-44d6-a22d-b065d19e9597 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:54.191574 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:54.202639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ef9b5-b6be-4b16-bb96-d575975a332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:54.203306 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef9b5-b6be-4b16-bb96-d575975a332d None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:54.213126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef9b5-b6be-4b16-bb96-d575975a332d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:54.213126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef9b5-b6be-4b16-bb96-d575975a332d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:54.231391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:54.246890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786c456-d41c-4d07-888c-d6ed4391b2bc None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:54.273541 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ef9b5-b6be-4b16-bb96-d575975a332d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:54.275011 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ef9b5-b6be-4b16-bb96-d575975a332d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:54.282107 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f87b3b-b288-4962-a513-54bacbd6986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:54.282730 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f87b3b-b288-4962-a513-54bacbd6986e None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:54.283009 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f87b3b-b288-4962-a513-54bacbd6986e None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:54.283317 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f87b3b-b288-4962-a513-54bacbd6986e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:54.293316 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f87b3b-b288-4962-a513-54bacbd6986e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:54.294769 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f87b3b-b288-4962-a513-54bacbd6986e None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-86f87b3b-b288-4962-a513-54bacbd6986e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:54.310066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:54.311120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:54.322494 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:54.322494 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:54.322494 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:54.322494 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 253/505] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:54.322494 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f87b3b-b288-4962-a513-54bacbd6986e None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:54.374817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 253/506] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:54.376143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ef9b5-b6be-4b16-bb96-d575975a332d None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:54.387028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:54.435531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f87b3b-b288-4962-a513-54bacbd6986e None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:54.477651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdebee-3b73-49ac-97ac-65bf5e2b1cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:54.478180 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdebee-3b73-49ac-97ac-65bf5e2b1cac None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:54.478462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdebee-3b73-49ac-97ac-65bf5e2b1cac None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:54.478739 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdebee-3b73-49ac-97ac-65bf5e2b1cac None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:54.479501 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdebee-3b73-49ac-97ac-65bf5e2b1cac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:54.479853 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdebee-3b73-49ac-97ac-65bf5e2b1cac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:54.481444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdebee-3b73-49ac-97ac-65bf5e2b1cac None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:54.490010 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:54.499969 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 254/507] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Aug 23 16:25:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:54.512091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdebee-3b73-49ac-97ac-65bf5e2b1cac None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:54.512317 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ef9b5-b6be-4b16-bb96-d575975a332d None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:54.539235 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6a636-e4db-42cf-8afc-35fac944a574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:54.548018 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6a636-e4db-42cf-8afc-35fac944a574 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:54.548018 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6a636-e4db-42cf-8afc-35fac944a574 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:54.548018 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6a636-e4db-42cf-8afc-35fac944a574 None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:54.548018 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6a636-e4db-42cf-8afc-35fac944a574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:54.548018 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6a636-e4db-42cf-8afc-35fac944a574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:54.548018 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6a636-e4db-42cf-8afc-35fac944a574 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:54.554145 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 254/508] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:54.554992 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6a636-e4db-42cf-8afc-35fac944a574 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:54.614597 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdebee-3b73-49ac-97ac-65bf5e2b1cac None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:54.624989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:54.656487 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809222f8-cb0f-4a4e-9bb3-041f9c0bc2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:54.657134 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809222f8-cb0f-4a4e-9bb3-041f9c0bc2eb None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:54.657411 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809222f8-cb0f-4a4e-9bb3-041f9c0bc2eb None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:54.657681 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809222f8-cb0f-4a4e-9bb3-041f9c0bc2eb None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:54.657973 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6a636-e4db-42cf-8afc-35fac944a574 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:54.658320 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809222f8-cb0f-4a4e-9bb3-041f9c0bc2eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:54.658616 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809222f8-cb0f-4a4e-9bb3-041f9c0bc2eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:54.660004 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809222f8-cb0f-4a4e-9bb3-041f9c0bc2eb None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:54.672038 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 255/509] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:54.672983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809222f8-cb0f-4a4e-9bb3-041f9c0bc2eb None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:54.696256 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280f6e2-2459-4530-b86f-4fbc84fa064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:54.696892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280f6e2-2459-4530-b86f-4fbc84fa064c None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:54.697165 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280f6e2-2459-4530-b86f-4fbc84fa064c None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:54.697444 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280f6e2-2459-4530-b86f-4fbc84fa064c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:54.708884 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280f6e2-2459-4530-b86f-4fbc84fa064c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:54.710386 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280f6e2-2459-4530-b86f-4fbc84fa064c None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-8280f6e2-2459-4530-b86f-4fbc84fa064c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:54.725845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:54.727055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:54.728196 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:54.728196 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:54.728196 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:54.728196 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 255/510] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:54.728196 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280f6e2-2459-4530-b86f-4fbc84fa064c None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:54.741141 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:54.786959 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809222f8-cb0f-4a4e-9bb3-041f9c0bc2eb None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:54.822802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e34d0-9b32-450a-9446-b61925291784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:54.823507 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e34d0-9b32-450a-9446-b61925291784 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:54.823816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e34d0-9b32-450a-9446-b61925291784 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:54.824085 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e34d0-9b32-450a-9446-b61925291784 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:54.834775 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280f6e2-2459-4530-b86f-4fbc84fa064c None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:54.856604 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:54.872080 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16804d-8bdc-4bc0-87ad-210fd70aff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:54.872763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16804d-8bdc-4bc0-87ad-210fd70aff7b None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:54.873063 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16804d-8bdc-4bc0-87ad-210fd70aff7b None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:54.873340 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16804d-8bdc-4bc0-87ad-210fd70aff7b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:54.881187 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16804d-8bdc-4bc0-87ad-210fd70aff7b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:54.882670 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16804d-8bdc-4bc0-87ad-210fd70aff7b None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:54.894343 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e34d0-9b32-450a-9446-b61925291784 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-1c16804d-8bdc-4bc0-87ad-210fd70aff7b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:25:54.895656 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:54.896872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:54.898287 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:54.898287 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:54.898287 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:25:54.898287 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:25:54.898287 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:25:54.898287 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:25:54.898287 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:25:54.898287 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:25:54.898287 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:25:54.898287 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:54.898926 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e34d0-9b32-450a-9446-b61925291784 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:54.899007 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 256/511] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:25:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:54.899697 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16804d-8bdc-4bc0-87ad-210fd70aff7b None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:54.967820 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:55.016455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 256/512] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:55.017233 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e34d0-9b32-450a-9446-b61925291784 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:55.019860 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16804d-8bdc-4bc0-87ad-210fd70aff7b None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:55.055357 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0945e-09e6-4dcf-bfc1-3213f87a18ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:55.055979 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0945e-09e6-4dcf-bfc1-3213f87a18ee None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:55.056257 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0945e-09e6-4dcf-bfc1-3213f87a18ee None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:55.056525 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0945e-09e6-4dcf-bfc1-3213f87a18ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:55.063420 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0945e-09e6-4dcf-bfc1-3213f87a18ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:55.064857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0945e-09e6-4dcf-bfc1-3213f87a18ee None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-71b0945e-09e6-4dcf-bfc1-3213f87a18ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:25:55.076932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:55.077920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:55.078817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:25:55.078817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:25:55.078817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:25:55.078817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:25:55.078817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:25:55.078817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:25:55.078817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:25:55.078817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:55.078817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 257/513] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:55.079353 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0945e-09e6-4dcf-bfc1-3213f87a18ee None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:55.120445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e34d0-9b32-450a-9446-b61925291784 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:55.122161 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:55.155190 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7356fa-7556-423f-8f2b-fc99eb76552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:55.155817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7356fa-7556-423f-8f2b-fc99eb76552c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:55.156094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7356fa-7556-423f-8f2b-fc99eb76552c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:55.156366 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7356fa-7556-423f-8f2b-fc99eb76552c None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:55.156998 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7356fa-7556-423f-8f2b-fc99eb76552c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:55.157300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7356fa-7556-423f-8f2b-fc99eb76552c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:55.158666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7356fa-7556-423f-8f2b-fc99eb76552c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:55.171219 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 257/514] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:55.172258 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7356fa-7556-423f-8f2b-fc99eb76552c None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:55.185250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0945e-09e6-4dcf-bfc1-3213f87a18ee None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:55.191819 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:55.220232 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc97a15-46a7-431c-bf51-b7765ffd5e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:55.221009 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc97a15-46a7-431c-bf51-b7765ffd5e7c None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:55.221290 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc97a15-46a7-431c-bf51-b7765ffd5e7c None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:55.221569 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc97a15-46a7-431c-bf51-b7765ffd5e7c None admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:55.222298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc97a15-46a7-431c-bf51-b7765ffd5e7c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:55.222606 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc97a15-46a7-431c-bf51-b7765ffd5e7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:55.224077 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc97a15-46a7-431c-bf51-b7765ffd5e7c None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:55.242942 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 258/515] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Aug 23 16:25:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:55.242942 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc97a15-46a7-431c-bf51-b7765ffd5e7c None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:55.280261 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7356fa-7556-423f-8f2b-fc99eb76552c None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:55.315547 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9038355-5e13-4d87-8925-8cdd08e82905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:55.316198 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038355-5e13-4d87-8925-8cdd08e82905 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:55.316469 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038355-5e13-4d87-8925-8cdd08e82905 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:55.316743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038355-5e13-4d87-8925-8cdd08e82905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:55.328363 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9038355-5e13-4d87-8925-8cdd08e82905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:55.329829 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9038355-5e13-4d87-8925-8cdd08e82905 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:55.344120 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-f9038355-5e13-4d87-8925-8cdd08e82905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:55.344850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:55.345900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:55.347057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:55.347057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:55.347057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:55.347057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 258/516] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:55.347057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9038355-5e13-4d87-8925-8cdd08e82905 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:55.351066 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc97a15-46a7-431c-bf51-b7765ffd5e7c None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:55.386064 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef7ce7-c6d7-44cb-99b4-bd85a3871fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:55.387239 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef7ce7-c6d7-44cb-99b4-bd85a3871fdb None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:55.387511 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef7ce7-c6d7-44cb-99b4-bd85a3871fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:55.387784 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef7ce7-c6d7-44cb-99b4-bd85a3871fdb None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:55.388508 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef7ce7-c6d7-44cb-99b4-bd85a3871fdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:55.389143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef7ce7-c6d7-44cb-99b4-bd85a3871fdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:55.391027 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef7ce7-c6d7-44cb-99b4-bd85a3871fdb None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:55.423281 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 259/517] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:55.428170 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:55.428327 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef7ce7-c6d7-44cb-99b4-bd85a3871fdb None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:55.462088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9038355-5e13-4d87-8925-8cdd08e82905 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:55.499899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972202-bf13-4653-9ae9-60ddd47f0ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:55.500612 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972202-bf13-4653-9ae9-60ddd47f0ba0 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:55.500817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972202-bf13-4653-9ae9-60ddd47f0ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:55.501090 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972202-bf13-4653-9ae9-60ddd47f0ba0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:55.509417 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2972202-bf13-4653-9ae9-60ddd47f0ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:55.510759 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2972202-bf13-4653-9ae9-60ddd47f0ba0 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-c2972202-bf13-4653-9ae9-60ddd47f0ba0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:25:55.525161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:55.526117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:55.527987 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:25:55.527987 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:25:55.527987 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:25:55.527987 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:25:55.527987 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:25:55.527987 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:25:55.527987 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:25:55.527987 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:55.527987 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 259/518] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:55.527987 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972202-bf13-4653-9ae9-60ddd47f0ba0 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:55.539358 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef7ce7-c6d7-44cb-99b4-bd85a3871fdb None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:55.576146 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65011c2-c918-4f2b-a1ab-bf9ddfe44380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:55.576767 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65011c2-c918-4f2b-a1ab-bf9ddfe44380 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:55.577043 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65011c2-c918-4f2b-a1ab-bf9ddfe44380 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:55.577311 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65011c2-c918-4f2b-a1ab-bf9ddfe44380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:55.607762 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:55.638581 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972202-bf13-4653-9ae9-60ddd47f0ba0 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:55.650873 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65011c2-c918-4f2b-a1ab-bf9ddfe44380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:55.653013 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65011c2-c918-4f2b-a1ab-bf9ddfe44380 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:55.671642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:55.680618 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60860d6f-4512-47fd-81ba-ce6eeb8a0dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:55.681239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60860d6f-4512-47fd-81ba-ce6eeb8a0dae None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:55.681515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60860d6f-4512-47fd-81ba-ce6eeb8a0dae None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:55.681796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60860d6f-4512-47fd-81ba-ce6eeb8a0dae None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:55.682440 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60860d6f-4512-47fd-81ba-ce6eeb8a0dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:55.682743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60860d6f-4512-47fd-81ba-ce6eeb8a0dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:55.684276 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60860d6f-4512-47fd-81ba-ce6eeb8a0dae None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:55.697266 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 260/519] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:55.703020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60860d6f-4512-47fd-81ba-ce6eeb8a0dae None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:55.765453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 260/520] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:25:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:25:55.766483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65011c2-c918-4f2b-a1ab-bf9ddfe44380 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:55.803625 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60860d6f-4512-47fd-81ba-ce6eeb8a0dae None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:55.825753 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:55.839253 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea9703-3cf4-4e04-aaf4-326b8c9998ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:55.839859 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea9703-3cf4-4e04-aaf4-326b8c9998ee None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:55.840131 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea9703-3cf4-4e04-aaf4-326b8c9998ee None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:55.840396 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea9703-3cf4-4e04-aaf4-326b8c9998ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:55.841108 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea9703-3cf4-4e04-aaf4-326b8c9998ee None admin] RBAC: Adding query filter params (role.id=2d13d41360794cff9c85249999f92061, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=db2c2345bf6e487bb3451fd6ce17f67f) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:55.841412 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea9703-3cf4-4e04-aaf4-326b8c9998ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:55.842832 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea9703-3cf4-4e04-aaf4-326b8c9998ee None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:55.848403 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 261/521] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:55 2022] GET /identity/v3/role_assignments?user.id=db2c2345bf6e487bb3451fd6ce17f67f&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=2d13d41360794cff9c85249999f92061 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:55.849208 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea9703-3cf4-4e04-aaf4-326b8c9998ee None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:55.869411 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65011c2-c918-4f2b-a1ab-bf9ddfe44380 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:55.910473 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6898bc-de7d-41e9-9bf3-d506d072271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:55.911189 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6898bc-de7d-41e9-9bf3-d506d072271d None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:55.911649 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6898bc-de7d-41e9-9bf3-d506d072271d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:55.911935 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6898bc-de7d-41e9-9bf3-d506d072271d None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:55.912651 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6898bc-de7d-41e9-9bf3-d506d072271d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:55.912956 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6898bc-de7d-41e9-9bf3-d506d072271d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:55.914486 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6898bc-de7d-41e9-9bf3-d506d072271d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:55.914948 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:55.927725 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 261/522] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:55.928620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6898bc-de7d-41e9-9bf3-d506d072271d None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:55.993896 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea9703-3cf4-4e04-aaf4-326b8c9998ee None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:56.033828 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db25b62-8b96-4312-8f2d-1be6e3e90df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:56.034471 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db25b62-8b96-4312-8f2d-1be6e3e90df6 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:56.034754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db25b62-8b96-4312-8f2d-1be6e3e90df6 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:56.035022 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db25b62-8b96-4312-8f2d-1be6e3e90df6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:56.043566 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db25b62-8b96-4312-8f2d-1be6e3e90df6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:56.045016 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db25b62-8b96-4312-8f2d-1be6e3e90df6 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:56.056015 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6898bc-de7d-41e9-9bf3-d506d072271d None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-5db25b62-8b96-4312-8f2d-1be6e3e90df6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:25:56.056579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:56.057376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:56.059075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:25:56.059075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:25:56.059075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:25:56.059075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:25:56.059075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:25:56.059075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:25:56.059075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:25:56.059075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:56.059075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 262/523] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:56.059655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db25b62-8b96-4312-8f2d-1be6e3e90df6 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:56.079275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:56.097688 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a9024-0c4b-42ea-b8b7-4413540a2b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:56.098427 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a9024-0c4b-42ea-b8b7-4413540a2b34 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:56.098760 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a9024-0c4b-42ea-b8b7-4413540a2b34 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:56.099065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a9024-0c4b-42ea-b8b7-4413540a2b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:56.111150 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a9024-0c4b-42ea-b8b7-4413540a2b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:56.112857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a9024-0c4b-42ea-b8b7-4413540a2b34 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-902a9024-0c4b-42ea-b8b7-4413540a2b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:56.130254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:56.131258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:56.132115 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:56.132115 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:56.132115 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:56.132115 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 262/524] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:56.132415 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a9024-0c4b-42ea-b8b7-4413540a2b34 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:56.174901 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db25b62-8b96-4312-8f2d-1be6e3e90df6 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:56.188836 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:56.211540 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4de2e-4503-49bb-b135-342ac37084e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:56.213079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4de2e-4503-49bb-b135-342ac37084e2 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:56.213371 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4de2e-4503-49bb-b135-342ac37084e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:56.213692 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4de2e-4503-49bb-b135-342ac37084e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:56.214488 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4de2e-4503-49bb-b135-342ac37084e2 None admin] RBAC: Adding query filter params (role.id=2d13d41360794cff9c85249999f92061, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=a7ffdfa226444449817acbcccb0b1c10) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:56.214784 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4de2e-4503-49bb-b135-342ac37084e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:56.216260 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4de2e-4503-49bb-b135-342ac37084e2 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:56.223137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 263/525] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:56 2022] GET /identity/v3/role_assignments?user.id=a7ffdfa226444449817acbcccb0b1c10&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=2d13d41360794cff9c85249999f92061 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:56.223922 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4de2e-4503-49bb-b135-342ac37084e2 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:56.265166 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a9024-0c4b-42ea-b8b7-4413540a2b34 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:56.317527 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de98e9-32ad-43f1-8294-38f95d081720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:56.318998 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de98e9-32ad-43f1-8294-38f95d081720 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:56.319758 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de98e9-32ad-43f1-8294-38f95d081720 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:56.320233 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de98e9-32ad-43f1-8294-38f95d081720 None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:56.321351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de98e9-32ad-43f1-8294-38f95d081720 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:56.322218 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de98e9-32ad-43f1-8294-38f95d081720 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:56.324097 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de98e9-32ad-43f1-8294-38f95d081720 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:56.339448 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4de2e-4503-49bb-b135-342ac37084e2 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:56.344905 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 263/526] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:56.352399 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de98e9-32ad-43f1-8294-38f95d081720 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:56.388864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:56.393311 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb76c9-db20-42bb-81e7-6d687ebc2e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:56.394522 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb76c9-db20-42bb-81e7-6d687ebc2e5c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:56.395974 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb76c9-db20-42bb-81e7-6d687ebc2e5c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:56.396540 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb76c9-db20-42bb-81e7-6d687ebc2e5c None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:56.397428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb76c9-db20-42bb-81e7-6d687ebc2e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:56.398213 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb76c9-db20-42bb-81e7-6d687ebc2e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:56.399980 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb76c9-db20-42bb-81e7-6d687ebc2e5c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:56.417250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 264/527] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:56.425097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb76c9-db20-42bb-81e7-6d687ebc2e5c None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:56.472127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:56.473551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de98e9-32ad-43f1-8294-38f95d081720 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:56.513532 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589f2a0-6115-41b1-b130-ce0acb39dd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:56.514652 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589f2a0-6115-41b1-b130-ce0acb39dd3e None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:56.515145 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589f2a0-6115-41b1-b130-ce0acb39dd3e None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:56.515658 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589f2a0-6115-41b1-b130-ce0acb39dd3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:56.516795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589f2a0-6115-41b1-b130-ce0acb39dd3e None admin] RBAC: Adding query filter params (role.id=2d13d41360794cff9c85249999f92061, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=0e1b4d1056614edea1585de5e531ed96) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:56.517419 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589f2a0-6115-41b1-b130-ce0acb39dd3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:56.519110 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589f2a0-6115-41b1-b130-ce0acb39dd3e None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:56.529719 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 264/528] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:56 2022] GET /identity/v3/role_assignments?user.id=0e1b4d1056614edea1585de5e531ed96&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=2d13d41360794cff9c85249999f92061 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:56.561037 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb76c9-db20-42bb-81e7-6d687ebc2e5c None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:56.600068 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf37ba9-a283-4255-945e-21037fb3cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:56.601147 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf37ba9-a283-4255-945e-21037fb3cb18 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:56.601620 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf37ba9-a283-4255-945e-21037fb3cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:56.602196 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf37ba9-a283-4255-945e-21037fb3cb18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:56.610869 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf37ba9-a283-4255-945e-21037fb3cb18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:56.612864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf37ba9-a283-4255-945e-21037fb3cb18 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-caf37ba9-a283-4255-945e-21037fb3cb18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:25:56.631195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:56.632148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:56.633426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:25:56.633426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:25:56.633426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:25:56.633426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:25:56.633426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:25:56.633426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:25:56.633426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:25:56.633426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:56.633426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 265/529] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:56.638674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589f2a0-6115-41b1-b130-ce0acb39dd3e None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:56.754215 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:56.764101 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589f2a0-6115-41b1-b130-ce0acb39dd3e None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:56.806496 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26f302-f095-433e-ae88-b94b8d2c141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:56.807105 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f302-f095-433e-ae88-b94b8d2c141b None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:56.807416 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f302-f095-433e-ae88-b94b8d2c141b None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:56.807689 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f302-f095-433e-ae88-b94b8d2c141b None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:56.808479 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26f302-f095-433e-ae88-b94b8d2c141b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:56.808780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26f302-f095-433e-ae88-b94b8d2c141b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:56.810229 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26f302-f095-433e-ae88-b94b8d2c141b None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:56.827709 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 265/530] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:56.829744 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf37ba9-a283-4255-945e-21037fb3cb18 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:56.935726 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:56.938377 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf37ba9-a283-4255-945e-21037fb3cb18 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:56.974647 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95d7fc-328c-47c6-afa7-3e08b1d61d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:56.975283 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95d7fc-328c-47c6-afa7-3e08b1d61d72 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:56.975566 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95d7fc-328c-47c6-afa7-3e08b1d61d72 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:56.975898 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95d7fc-328c-47c6-afa7-3e08b1d61d72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:56.976630 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95d7fc-328c-47c6-afa7-3e08b1d61d72 None admin] RBAC: Adding query filter params (role.id=2d13d41360794cff9c85249999f92061, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=74e4ab73defe45cb90e60e5719c5d0fe) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:56.976941 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95d7fc-328c-47c6-afa7-3e08b1d61d72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:56.978375 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95d7fc-328c-47c6-afa7-3e08b1d61d72 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:56.989565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 266/531] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:25:56 2022] GET /identity/v3/role_assignments?user.id=74e4ab73defe45cb90e60e5719c5d0fe&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=2d13d41360794cff9c85249999f92061 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:58.192166 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfd08b-4b28-49ca-b008-de0cb53fb6df None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:58.192685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfd08b-4b28-49ca-b008-de0cb53fb6df None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:58.192760 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfd08b-4b28-49ca-b008-de0cb53fb6df None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:58.194329 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 266/532] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:58.200569 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d723ae-6f4a-4e35-9c27-edd0207a1150 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:58.201044 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d723ae-6f4a-4e35-9c27-edd0207a1150 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:58.201116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d723ae-6f4a-4e35-9c27-edd0207a1150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:58.220233 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-d3d723ae-6f4a-4e35-9c27-edd0207a1150 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:58.221435 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-d3d723ae-6f4a-4e35-9c27-edd0207a1150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:58.301240 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 267/533] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:58.491046 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb105ab5-ee6c-41d7-be8a-5a8e523dd03d None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:58.491379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb105ab5-ee6c-41d7-be8a-5a8e523dd03d None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:58.491557 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb105ab5-ee6c-41d7-be8a-5a8e523dd03d None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:58.493275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 267/534] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:58.499073 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59251779-702f-4935-bea4-ae186bf3ccc7 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:58.499416 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59251779-702f-4935-bea4-ae186bf3ccc7 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:58.499695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59251779-702f-4935-bea4-ae186bf3ccc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:58.518572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-59251779-702f-4935-bea4-ae186bf3ccc7 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:58.519828 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-59251779-702f-4935-bea4-ae186bf3ccc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:58.600054 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 268/535] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:58.655341 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb105ab5-ee6c-41d7-be8a-5a8e523dd03d None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:58.782057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb105ab5-ee6c-41d7-be8a-5a8e523dd03d None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:58.822922 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a360e-3b12-4fac-aec1-3426bd7458aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:58.823640 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a360e-3b12-4fac-aec1-3426bd7458aa None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:58.823917 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a360e-3b12-4fac-aec1-3426bd7458aa None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:58.824186 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a360e-3b12-4fac-aec1-3426bd7458aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:58.836667 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a360e-3b12-4fac-aec1-3426bd7458aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-bc5a360e-3b12-4fac-aec1-3426bd7458aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:58.842098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:58.843293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:58.844542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:58.844542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:58.844542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:58.844542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:58.844542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:58.844542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:58.844542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:58.844542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:58.844542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:58.844542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:58.844542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:58.844542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:58.844542 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 268/536] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:25:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:58.852863 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59251779-702f-4935-bea4-ae186bf3ccc7 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:58.861645 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7f45e-3558-42c4-b930-e530f775ded4 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:58.862308 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7f45e-3558-42c4-b930-e530f775ded4 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:58.862757 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7f45e-3558-42c4-b930-e530f775ded4 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:58.865795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 269/537] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:25:58.870873 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98181d30-69b0-4190-975e-4bee571861df None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:58.871411 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98181d30-69b0-4190-975e-4bee571861df None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:58.871824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98181d30-69b0-4190-975e-4bee571861df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:58.879322 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:58.896943 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-98181d30-69b0-4190-975e-4bee571861df None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:58.898737 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-98181d30-69b0-4190-975e-4bee571861df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:58.913058 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:58.972868 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59251779-702f-4935-bea4-ae186bf3ccc7 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:58.992462 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 270/538] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:25:59.004299 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98181d30-69b0-4190-975e-4bee571861df None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:59.013557 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f491-9756-4b8d-82d6-7b0a7e94c05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:59.014425 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f491-9756-4b8d-82d6-7b0a7e94c05f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:59.014873 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f491-9756-4b8d-82d6-7b0a7e94c05f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:59.015634 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f491-9756-4b8d-82d6-7b0a7e94c05f None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:59.016510 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f491-9756-4b8d-82d6-7b0a7e94c05f None admin] RBAC: Adding query filter params (name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:59.017020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f491-9756-4b8d-82d6-7b0a7e94c05f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:59.018779 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f491-9756-4b8d-82d6-7b0a7e94c05f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:59.029863 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 269/539] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:25:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:59.039321 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f491-9756-4b8d-82d6-7b0a7e94c05f None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:59.134656 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:59.142140 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98181d30-69b0-4190-975e-4bee571861df None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:59.157621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f491-9756-4b8d-82d6-7b0a7e94c05f None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:59.195037 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a6782-ec4c-40bf-827c-b10bfbc30b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:59.196901 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a6782-ec4c-40bf-827c-b10bfbc30b40 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:59.197434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a6782-ec4c-40bf-827c-b10bfbc30b40 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:59.197979 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a6782-ec4c-40bf-827c-b10bfbc30b40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:59.202239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b017e-5408-4bf0-a063-2dd77d11578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:59.202831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b017e-5408-4bf0-a063-2dd77d11578d None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:59.203199 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b017e-5408-4bf0-a063-2dd77d11578d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:59.203588 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b017e-5408-4bf0-a063-2dd77d11578d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:59.212430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a6782-ec4c-40bf-827c-b10bfbc30b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:59.216134 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b017e-5408-4bf0-a063-2dd77d11578d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:59.217825 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b017e-5408-4bf0-a063-2dd77d11578d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-4f5a6782-ec4c-40bf-827c-b10bfbc30b40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:59.220017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:59.221057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:59.221840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:59.221840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:59.221840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:59.221840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:59.221840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:59.221840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:59.221840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:59.221840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:59.221840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:59.221840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:59.221840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:59.221840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:59.224588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 271/540] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:25:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:59.229901 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a6782-ec4c-40bf-827c-b10bfbc30b40 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-264b017e-5408-4bf0-a063-2dd77d11578d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:59.237787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:59.238783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:59.239667 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:59.239667 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:59.239667 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:59.241012 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 270/541] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:59.247274 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:59.248342 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b017e-5408-4bf0-a063-2dd77d11578d None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:59.355674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a6782-ec4c-40bf-827c-b10bfbc30b40 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:59.375413 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b017e-5408-4bf0-a063-2dd77d11578d None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:59.389145 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f981c88-1608-465b-b30b-531c82397c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:59.389756 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f981c88-1608-465b-b30b-531c82397c4a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:59.390037 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f981c88-1608-465b-b30b-531c82397c4a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:59.390307 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f981c88-1608-465b-b30b-531c82397c4a None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:59.390963 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f981c88-1608-465b-b30b-531c82397c4a None admin] RBAC: Adding query filter params (name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:59.391290 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f981c88-1608-465b-b30b-531c82397c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:59.392664 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f981c88-1608-465b-b30b-531c82397c4a None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:59.401155 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 272/542] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:25:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:25:59.403389 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f981c88-1608-465b-b30b-531c82397c4a None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:59.414451 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aa3a0-4da4-4ca0-97b8-f8d5b55109a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:59.416022 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa3a0-4da4-4ca0-97b8-f8d5b55109a2 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:59.416022 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa3a0-4da4-4ca0-97b8-f8d5b55109a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:59.416022 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa3a0-4da4-4ca0-97b8-f8d5b55109a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:59.416770 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543aa3a0-4da4-4ca0-97b8-f8d5b55109a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:59.417101 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543aa3a0-4da4-4ca0-97b8-f8d5b55109a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:59.418505 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543aa3a0-4da4-4ca0-97b8-f8d5b55109a2 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:59.420040 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:59.431052 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 271/543] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:59.432333 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4032dd-2788-4482-ba5b-25cfab958928 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:59.432609 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4032dd-2788-4482-ba5b-25cfab958928 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:59.432913 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4032dd-2788-4482-ba5b-25cfab958928 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:59.436362 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 272/544] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:59.436362 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4032dd-2788-4482-ba5b-25cfab958928 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:59.478146 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:59.516077 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f981c88-1608-465b-b30b-531c82397c4a None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:59.540359 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4032dd-2788-4482-ba5b-25cfab958928 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:59.553426 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a4308-8cfd-4b5b-b171-f04d3ff845af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:59.554067 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a4308-8cfd-4b5b-b171-f04d3ff845af None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:59.554362 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a4308-8cfd-4b5b-b171-f04d3ff845af None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:59.554621 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a4308-8cfd-4b5b-b171-f04d3ff845af None admin] PATH_INFO: `/v3/roles/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:59.566303 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a4308-8cfd-4b5b-b171-f04d3ff845af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-192a4308-8cfd-4b5b-b171-f04d3ff845af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:25:59.571522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:59.572521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:59.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:59.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:59.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:59.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:59.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:25:59.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:25:59.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:25:59.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:25:59.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:25:59.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:25:59.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:25:59.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:59.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 273/545] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:25:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:59.574788 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a4308-8cfd-4b5b-b171-f04d3ff845af None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:59.589307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464bcbf-cb2b-4f0c-bfb5-98643a1c1142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:59.591153 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464bcbf-cb2b-4f0c-bfb5-98643a1c1142 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:59.591153 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464bcbf-cb2b-4f0c-bfb5-98643a1c1142 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:59.591153 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464bcbf-cb2b-4f0c-bfb5-98643a1c1142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:59.601617 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464bcbf-cb2b-4f0c-bfb5-98643a1c1142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:59.603168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464bcbf-cb2b-4f0c-bfb5-98643a1c1142 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-d464bcbf-cb2b-4f0c-bfb5-98643a1c1142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:25:59.619019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:59.619995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:25:59.621422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:25:59.621422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:25:59.621422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:25:59.621422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 273/546] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:59.621956 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d684e-a4f4-4aa3-a305-7cd3dfe1321f None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:59.622116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d684e-a4f4-4aa3-a305-7cd3dfe1321f None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:59.622395 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d684e-a4f4-4aa3-a305-7cd3dfe1321f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:59.641466 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-175d684e-a4f4-4aa3-a305-7cd3dfe1321f None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:59.642700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-175d684e-a4f4-4aa3-a305-7cd3dfe1321f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:59.688149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:59.690492 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a4308-8cfd-4b5b-b171-f04d3ff845af None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:59.713838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 274/547] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:25:59.714758 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d684e-a4f4-4aa3-a305-7cd3dfe1321f None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:59.730277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:59.738838 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6cb3f-94b5-43c1-8045-f0dc591028c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:59.739504 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6cb3f-94b5-43c1-8045-f0dc591028c3 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:59.739812 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6cb3f-94b5-43c1-8045-f0dc591028c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:59.740070 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6cb3f-94b5-43c1-8045-f0dc591028c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:59.748087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6cb3f-94b5-43c1-8045-f0dc591028c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:59.749550 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6cb3f-94b5-43c1-8045-f0dc591028c3 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-32d6cb3f-94b5-43c1-8045-f0dc591028c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:25:59.762378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:25:59.763360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:25:59.764249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:25:59.764249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:25:59.764249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:25:59.764249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:25:59.764249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:25:59.764249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:25:59.764249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:25:59.764249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:25:59.764249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:25:59.764249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:25:59.764249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 274/548] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Aug 23 16:25:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:25:59.764800 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6cb3f-94b5-43c1-8045-f0dc591028c3 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:59.846270 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d684e-a4f4-4aa3-a305-7cd3dfe1321f None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:59.880520 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6cb3f-94b5-43c1-8045-f0dc591028c3 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:59.883365 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cf78b-ec9a-4c4e-81ce-21a91b0f8b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:59.883975 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cf78b-ec9a-4c4e-81ce-21a91b0f8b8f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:59.884251 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cf78b-ec9a-4c4e-81ce-21a91b0f8b8f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:59.884521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cf78b-ec9a-4c4e-81ce-21a91b0f8b8f None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:59.885179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cf78b-ec9a-4c4e-81ce-21a91b0f8b8f None admin] RBAC: Adding query filter params (name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:59.885482 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cf78b-ec9a-4c4e-81ce-21a91b0f8b8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:59.886935 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cf78b-ec9a-4c4e-81ce-21a91b0f8b8f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:59.899509 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 275/549] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:25:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:59.899509 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cf78b-ec9a-4c4e-81ce-21a91b0f8b8f None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:59.925348 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152c204-ed4e-4ecc-ab18-fc80ee6974af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:59.926496 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152c204-ed4e-4ecc-ab18-fc80ee6974af None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:59.927110 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152c204-ed4e-4ecc-ab18-fc80ee6974af None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:59.927645 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152c204-ed4e-4ecc-ab18-fc80ee6974af None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:59.928807 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152c204-ed4e-4ecc-ab18-fc80ee6974af None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:25:59.929333 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152c204-ed4e-4ecc-ab18-fc80ee6974af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:59.931306 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152c204-ed4e-4ecc-ab18-fc80ee6974af None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:59.942482 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:59.949719 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 275/550] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:25:59.950669 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152c204-ed4e-4ecc-ab18-fc80ee6974af None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:00.003661 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:00.015927 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cf78b-ec9a-4c4e-81ce-21a91b0f8b8f None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:00.054336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1782499-322b-4a20-974f-033a78193d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:00.054993 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1782499-322b-4a20-974f-033a78193d6d None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.055309 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1782499-322b-4a20-974f-033a78193d6d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.055658 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1782499-322b-4a20-974f-033a78193d6d None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.056369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1782499-322b-4a20-974f-033a78193d6d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:00.056665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1782499-322b-4a20-974f-033a78193d6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:00.058678 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1782499-322b-4a20-974f-033a78193d6d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:00.060775 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152c204-ed4e-4ecc-ab18-fc80ee6974af None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:00.076530 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 276/551] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Aug 23 16:25:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:00.077953 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1782499-322b-4a20-974f-033a78193d6d None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:00.097596 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70859e80-bfc4-47f7-83dd-88c4ad6a5cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:00.098233 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70859e80-bfc4-47f7-83dd-88c4ad6a5cdc None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.098481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70859e80-bfc4-47f7-83dd-88c4ad6a5cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.098747 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70859e80-bfc4-47f7-83dd-88c4ad6a5cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.109289 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70859e80-bfc4-47f7-83dd-88c4ad6a5cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:00.110739 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70859e80-bfc4-47f7-83dd-88c4ad6a5cdc None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-70859e80-bfc4-47f7-83dd-88c4ad6a5cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:00.125441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:00.126787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:00.127803 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:00.127803 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:00.127803 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:00.127803 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 276/552] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:00.127803 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70859e80-bfc4-47f7-83dd-88c4ad6a5cdc None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:00.176874 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:00.183441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1782499-322b-4a20-974f-033a78193d6d None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:00.218218 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708800d-d5a7-490c-aead-c1cd11c01fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:00.218871 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708800d-d5a7-490c-aead-c1cd11c01fba None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.219110 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708800d-d5a7-490c-aead-c1cd11c01fba None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.219421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708800d-d5a7-490c-aead-c1cd11c01fba None admin] PATH_INFO: `/v3/users/glance` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.226582 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708800d-d5a7-490c-aead-c1cd11c01fba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:00.228065 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708800d-d5a7-490c-aead-c1cd11c01fba None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:00.228206 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:00.233501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70859e80-bfc4-47f7-83dd-88c4ad6a5cdc None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-9708800d-d5a7-490c-aead-c1cd11c01fba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:26:00.240862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:00.241904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:00.242966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:00.242966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:00.242966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:26:00.242966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:26:00.242966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:26:00.242966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:26:00.242966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:26:00.242966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:26:00.242966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:26:00.242966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:00.242966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 277/553] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:26:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:00.242966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708800d-d5a7-490c-aead-c1cd11c01fba None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:00.273264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b92cb-10a1-41a3-9452-3b87b7f02fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:00.273890 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b92cb-10a1-41a3-9452-3b87b7f02fa7 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.274174 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b92cb-10a1-41a3-9452-3b87b7f02fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.274450 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b92cb-10a1-41a3-9452-3b87b7f02fa7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.285215 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b92cb-10a1-41a3-9452-3b87b7f02fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-d75b92cb-10a1-41a3-9452-3b87b7f02fa7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:26:00.290387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:00.291639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:00.293047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:00.293047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:00.293047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:00.293047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:00.293047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:26:00.293047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:26:00.293047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:26:00.293047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:26:00.293047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:26:00.293047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:26:00.293047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:26:00.293047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:00.293047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 277/554] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:26:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:00.294206 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b92cb-10a1-41a3-9452-3b87b7f02fa7 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:00.348896 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708800d-d5a7-490c-aead-c1cd11c01fba None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:00.384779 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde95b7-7317-4e0a-906a-2f13981037bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:00.385485 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde95b7-7317-4e0a-906a-2f13981037bb None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.385839 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde95b7-7317-4e0a-906a-2f13981037bb None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.386057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde95b7-7317-4e0a-906a-2f13981037bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.398056 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde95b7-7317-4e0a-906a-2f13981037bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:00.399529 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde95b7-7317-4e0a-906a-2f13981037bb None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:00.399805 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b92cb-10a1-41a3-9452-3b87b7f02fa7 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-2bde95b7-7317-4e0a-906a-2f13981037bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:00.414352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:00.415665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:00.416669 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:00.416669 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:00.416669 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:00.416669 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 278/555] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:00.416669 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde95b7-7317-4e0a-906a-2f13981037bb None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:00.429282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:00.443998 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c4664-cf09-47da-88de-f80c83c7d15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:00.444604 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c4664-cf09-47da-88de-f80c83c7d15f None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.444882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c4664-cf09-47da-88de-f80c83c7d15f None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.445152 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c4664-cf09-47da-88de-f80c83c7d15f None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.445794 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c4664-cf09-47da-88de-f80c83c7d15f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:00.446096 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c4664-cf09-47da-88de-f80c83c7d15f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:00.447595 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c4664-cf09-47da-88de-f80c83c7d15f None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:00.459278 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 278/556] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:00.460103 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c4664-cf09-47da-88de-f80c83c7d15f None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:00.481350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:00.519872 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde95b7-7317-4e0a-906a-2f13981037bb None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:00.555761 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4c487-578e-4337-aef8-325627eb320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:00.556394 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4c487-578e-4337-aef8-325627eb320d None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.556677 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4c487-578e-4337-aef8-325627eb320d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.556958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4c487-578e-4337-aef8-325627eb320d None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.557709 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4c487-578e-4337-aef8-325627eb320d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:00.558061 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4c487-578e-4337-aef8-325627eb320d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:00.559511 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4c487-578e-4337-aef8-325627eb320d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:00.569287 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c4664-cf09-47da-88de-f80c83c7d15f None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:00.577689 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 279/557] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Aug 23 16:26:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:00.578563 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4c487-578e-4337-aef8-325627eb320d None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:00.608855 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a1d09-097b-4d7b-b361-20e8bce86996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:00.609468 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a1d09-097b-4d7b-b361-20e8bce86996 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.609752 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a1d09-097b-4d7b-b361-20e8bce86996 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.610026 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a1d09-097b-4d7b-b361-20e8bce86996 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.610692 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a1d09-097b-4d7b-b361-20e8bce86996 None admin] RBAC: Adding query filter params (name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:00.611000 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a1d09-097b-4d7b-b361-20e8bce86996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:00.612577 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a1d09-097b-4d7b-b361-20e8bce86996 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:00.621111 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 279/558] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:26:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:00.621940 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a1d09-097b-4d7b-b361-20e8bce86996 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:00.650100 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:00.685297 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4c487-578e-4337-aef8-325627eb320d None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:00.707079 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:00.721636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b918a-3c7f-435d-9637-6a2038e8aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:00.722237 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b918a-3c7f-435d-9637-6a2038e8aa45 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.722514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b918a-3c7f-435d-9637-6a2038e8aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.722785 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b918a-3c7f-435d-9637-6a2038e8aa45 None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.723443 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b918a-3c7f-435d-9637-6a2038e8aa45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:00.723749 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b918a-3c7f-435d-9637-6a2038e8aa45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:00.725109 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b918a-3c7f-435d-9637-6a2038e8aa45 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:00.726274 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a1d09-097b-4d7b-b361-20e8bce86996 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:00.737011 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 280/559] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:00.737011 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b918a-3c7f-435d-9637-6a2038e8aa45 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:00.761555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aa096-c141-44e2-b23e-cab23909f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:00.762185 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aa096-c141-44e2-b23e-cab23909f474 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.762464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aa096-c141-44e2-b23e-cab23909f474 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.762735 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aa096-c141-44e2-b23e-cab23909f474 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.770358 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0aa096-c141-44e2-b23e-cab23909f474 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:00.771956 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0aa096-c141-44e2-b23e-cab23909f474 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-ad0aa096-c141-44e2-b23e-cab23909f474 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:26:00.784352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:00.785547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:00.786512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:00.786512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:00.786512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:26:00.786512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:26:00.786512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:26:00.786512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:26:00.786512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:26:00.786512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:26:00.786512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:26:00.786512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:00.786512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 280/560] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:26:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:00.786512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aa096-c141-44e2-b23e-cab23909f474 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:00.846710 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b918a-3c7f-435d-9637-6a2038e8aa45 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:00.872297 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:00.880634 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab675-0899-48c9-abe9-b005d2b3fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:00.881263 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab675-0899-48c9-abe9-b005d2b3fe8b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.881927 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab675-0899-48c9-abe9-b005d2b3fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.881927 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab675-0899-48c9-abe9-b005d2b3fe8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.893266 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ab675-0899-48c9-abe9-b005d2b3fe8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:00.893761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aa096-c141-44e2-b23e-cab23909f474 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:00.894700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ab675-0899-48c9-abe9-b005d2b3fe8b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-137ab675-0899-48c9-abe9-b005d2b3fe8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:00.910118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:00.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:00.916679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:00.916679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:00.916679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:00.916679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 281/561] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:00.916679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab675-0899-48c9-abe9-b005d2b3fe8b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:00.928475 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73dd35-39b1-4fb7-87eb-211b0b3b51e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:00.929102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73dd35-39b1-4fb7-87eb-211b0b3b51e8 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.929412 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73dd35-39b1-4fb7-87eb-211b0b3b51e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.929692 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73dd35-39b1-4fb7-87eb-211b0b3b51e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.938983 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:00.941452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73dd35-39b1-4fb7-87eb-211b0b3b51e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:00.942930 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73dd35-39b1-4fb7-87eb-211b0b3b51e8 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-cb73dd35-39b1-4fb7-87eb-211b0b3b51e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:00.957624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:00.958802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:00.959844 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:00.959844 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:00.959844 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:00.959844 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 281/562] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:00.960065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73dd35-39b1-4fb7-87eb-211b0b3b51e8 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:01.019915 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab675-0899-48c9-abe9-b005d2b3fe8b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:01.053527 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be88e-7975-45fe-b67d-c7ad2af01a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:01.054248 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be88e-7975-45fe-b67d-c7ad2af01a26 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:01.054531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be88e-7975-45fe-b67d-c7ad2af01a26 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:01.054803 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be88e-7975-45fe-b67d-c7ad2af01a26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:01.061824 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7be88e-7975-45fe-b67d-c7ad2af01a26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:01.063397 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7be88e-7975-45fe-b67d-c7ad2af01a26 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:01.064955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73dd35-39b1-4fb7-87eb-211b0b3b51e8 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-6c7be88e-7975-45fe-b67d-c7ad2af01a26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:26:01.075635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:01.076587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:01.077462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:26:01.077462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:26:01.077462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:26:01.077462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:26:01.077462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:26:01.077462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:26:01.077462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:01.077462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:01.077462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 282/563] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:01.077938 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be88e-7975-45fe-b67d-c7ad2af01a26 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:01.102171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e988a6a-b71a-4d7c-9bb4-7b2de457b4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:01.102779 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e988a6a-b71a-4d7c-9bb4-7b2de457b4e8 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:01.103066 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e988a6a-b71a-4d7c-9bb4-7b2de457b4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:01.103359 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e988a6a-b71a-4d7c-9bb4-7b2de457b4e8 None admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:01.104084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e988a6a-b71a-4d7c-9bb4-7b2de457b4e8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:01.104398 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e988a6a-b71a-4d7c-9bb4-7b2de457b4e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:01.105816 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e988a6a-b71a-4d7c-9bb4-7b2de457b4e8 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:01.118265 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:01.123487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 282/564] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Aug 23 16:26:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:01.124320 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e988a6a-b71a-4d7c-9bb4-7b2de457b4e8 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:01.173689 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:01.184022 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be88e-7975-45fe-b67d-c7ad2af01a26 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:01.218222 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee5cd3-ecec-409f-a5c6-9255ddccbe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:01.218733 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee5cd3-ecec-409f-a5c6-9255ddccbe24 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:01.219305 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee5cd3-ecec-409f-a5c6-9255ddccbe24 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:01.219305 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee5cd3-ecec-409f-a5c6-9255ddccbe24 None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:01.219904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee5cd3-ecec-409f-a5c6-9255ddccbe24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:01.220202 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee5cd3-ecec-409f-a5c6-9255ddccbe24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:01.221559 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee5cd3-ecec-409f-a5c6-9255ddccbe24 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:01.225952 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e988a6a-b71a-4d7c-9bb4-7b2de457b4e8 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:01.233028 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 283/565] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:01.233836 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee5cd3-ecec-409f-a5c6-9255ddccbe24 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:01.261757 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648aa0f6-0c6c-4332-80f8-c1d90cf9aeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:01.262353 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aa0f6-0c6c-4332-80f8-c1d90cf9aeb5 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:01.262626 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aa0f6-0c6c-4332-80f8-c1d90cf9aeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:01.262887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aa0f6-0c6c-4332-80f8-c1d90cf9aeb5 None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:01.263556 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648aa0f6-0c6c-4332-80f8-c1d90cf9aeb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:01.263849 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648aa0f6-0c6c-4332-80f8-c1d90cf9aeb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:01.265208 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648aa0f6-0c6c-4332-80f8-c1d90cf9aeb5 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:01.277128 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 283/566] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:01.278004 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648aa0f6-0c6c-4332-80f8-c1d90cf9aeb5 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:01.342965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:01.347118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee5cd3-ecec-409f-a5c6-9255ddccbe24 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:01.382390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86329269-4f29-4589-b40f-64a50b6262cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:01.382998 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86329269-4f29-4589-b40f-64a50b6262cb None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:01.383296 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86329269-4f29-4589-b40f-64a50b6262cb None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:01.383577 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86329269-4f29-4589-b40f-64a50b6262cb None admin] PATH_INFO: `/v3/projects` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:01.384256 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86329269-4f29-4589-b40f-64a50b6262cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:01.384563 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86329269-4f29-4589-b40f-64a50b6262cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:01.386064 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86329269-4f29-4589-b40f-64a50b6262cb None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:01.386307 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648aa0f6-0c6c-4332-80f8-c1d90cf9aeb5 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:01.397416 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:01.404211 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 284/567] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:01.415491 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86329269-4f29-4589-b40f-64a50b6262cb None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:01.425193 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c295b88-b80f-4cb0-b72f-f1dea2077ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:01.425829 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c295b88-b80f-4cb0-b72f-f1dea2077ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:01.426108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c295b88-b80f-4cb0-b72f-f1dea2077ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:01.426380 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c295b88-b80f-4cb0-b72f-f1dea2077ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:01.438124 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c295b88-b80f-4cb0-b72f-f1dea2077ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:01.439600 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c295b88-b80f-4cb0-b72f-f1dea2077ac9 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-7c295b88-b80f-4cb0-b72f-f1dea2077ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:01.453882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:01.454969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:01.455889 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:01.455889 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:01.455889 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:01.455889 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 284/568] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:01.455889 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c295b88-b80f-4cb0-b72f-f1dea2077ac9 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:01.518065 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86329269-4f29-4589-b40f-64a50b6262cb None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:01.551830 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcb71b-0b88-4315-aeea-871eb24d399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:01.552458 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb71b-0b88-4315-aeea-871eb24d399d None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:01.552738 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb71b-0b88-4315-aeea-871eb24d399d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:01.553013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb71b-0b88-4315-aeea-871eb24d399d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:01.560397 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcb71b-0b88-4315-aeea-871eb24d399d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:01.561844 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcb71b-0b88-4315-aeea-871eb24d399d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:01.564979 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c295b88-b80f-4cb0-b72f-f1dea2077ac9 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-5adcb71b-0b88-4315-aeea-871eb24d399d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:26:01.574079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:01.575116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:01.576518 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:26:01.576518 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:26:01.576518 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:26:01.576518 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:26:01.576518 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:26:01.576518 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:26:01.576518 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:01.576518 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:01.576518 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 285/569] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:01.576518 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcb71b-0b88-4315-aeea-871eb24d399d None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:01.595252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:01.610028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d875331-ca1c-423e-a6d6-78a307f5cf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:01.610909 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d875331-ca1c-423e-a6d6-78a307f5cf9e None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:01.611118 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d875331-ca1c-423e-a6d6-78a307f5cf9e None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:01.611448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d875331-ca1c-423e-a6d6-78a307f5cf9e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:01.619381 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d875331-ca1c-423e-a6d6-78a307f5cf9e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:01.621417 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d875331-ca1c-423e-a6d6-78a307f5cf9e None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-9d875331-ca1c-423e-a6d6-78a307f5cf9e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:26:01.632995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:01.634153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:01.635392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:01.635392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:01.635392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:26:01.635392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:26:01.635392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:26:01.635392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:26:01.635392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:26:01.635392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:26:01.635392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:26:01.635392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:01.635392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 285/570] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:26:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:01.635392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d875331-ca1c-423e-a6d6-78a307f5cf9e None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:01.663099 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:01.681412 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcb71b-0b88-4315-aeea-871eb24d399d None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:01.716949 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929525a2-240e-4480-9f8f-f06c43efd84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:01.717959 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929525a2-240e-4480-9f8f-f06c43efd84e None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:01.718237 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929525a2-240e-4480-9f8f-f06c43efd84e None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:01.718512 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929525a2-240e-4480-9f8f-f06c43efd84e None admin] PATH_INFO: `/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/db2c2345bf6e487bb3451fd6ce17f67f/roles/2d13d41360794cff9c85249999f92061` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:01.734233 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929525a2-240e-4480-9f8f-f06c43efd84e None admin] RBAC: Authorizing `identity:create_grant(project_id=947f199ed73148beb3a4ecbc82cded19, user_id=db2c2345bf6e487bb3451fd6ce17f67f, role_id=2d13d41360794cff9c85249999f92061)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:01.735831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929525a2-240e-4480-9f8f-f06c43efd84e None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:01.740666 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d875331-ca1c-423e-a6d6-78a307f5cf9e None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:01.774208 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db05615-6398-415d-8cc0-ba01a1302725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:01.774817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db05615-6398-415d-8cc0-ba01a1302725 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:01.775098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db05615-6398-415d-8cc0-ba01a1302725 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:01.775405 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db05615-6398-415d-8cc0-ba01a1302725 None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:01.776050 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db05615-6398-415d-8cc0-ba01a1302725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:01.776857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db05615-6398-415d-8cc0-ba01a1302725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:01.778256 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db05615-6398-415d-8cc0-ba01a1302725 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:01.790127 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 286/571] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:01.791017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db05615-6398-415d-8cc0-ba01a1302725 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:01.807855 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 286/572] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:26:01 2022] PUT /identity/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/db2c2345bf6e487bb3451fd6ce17f67f/roles/2d13d41360794cff9c85249999f92061 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:26:01.808694 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929525a2-240e-4480-9f8f-f06c43efd84e None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:01.885064 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:01.897128 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:01.916186 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db05615-6398-415d-8cc0-ba01a1302725 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:01.939519 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929525a2-240e-4480-9f8f-f06c43efd84e None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:01.969601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def4d2e-41f5-4976-84d3-0d7398bb0d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:01.970491 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def4d2e-41f5-4976-84d3-0d7398bb0d34 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:01.970777 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def4d2e-41f5-4976-84d3-0d7398bb0d34 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:01.971050 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def4d2e-41f5-4976-84d3-0d7398bb0d34 None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:01.971838 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def4d2e-41f5-4976-84d3-0d7398bb0d34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:01.972153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def4d2e-41f5-4976-84d3-0d7398bb0d34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:01.973708 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def4d2e-41f5-4976-84d3-0d7398bb0d34 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:01.983936 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0bac4-016e-4c40-99fa-d144a117ac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:01.985754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0bac4-016e-4c40-99fa-d144a117ac37 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:01.987478 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0bac4-016e-4c40-99fa-d144a117ac37 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:01.987606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0bac4-016e-4c40-99fa-d144a117ac37 None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:01.988406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0bac4-016e-4c40-99fa-d144a117ac37 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:01.988725 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0bac4-016e-4c40-99fa-d144a117ac37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:01.990260 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0bac4-016e-4c40-99fa-d144a117ac37 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:01.994235 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 287/573] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:01.995164 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def4d2e-41f5-4976-84d3-0d7398bb0d34 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:02.015780 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 287/574] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Aug 23 16:26:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:02.016666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0bac4-016e-4c40-99fa-d144a117ac37 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:02.131947 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def4d2e-41f5-4976-84d3-0d7398bb0d34 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:02.143942 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0bac4-016e-4c40-99fa-d144a117ac37 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:02.174523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:02.177038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ea3e7-521c-4af7-9e17-6a0b1ff91090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:02.177736 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ea3e7-521c-4af7-9e17-6a0b1ff91090 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:02.178027 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ea3e7-521c-4af7-9e17-6a0b1ff91090 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:02.178300 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ea3e7-521c-4af7-9e17-6a0b1ff91090 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:02.185654 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7328cd-7111-45d2-b366-d8284e093bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:02.186026 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ea3e7-521c-4af7-9e17-6a0b1ff91090 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:02.186737 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7328cd-7111-45d2-b366-d8284e093bd7 None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:02.187360 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7328cd-7111-45d2-b366-d8284e093bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:02.187468 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ea3e7-521c-4af7-9e17-6a0b1ff91090 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:02.192800 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7328cd-7111-45d2-b366-d8284e093bd7 None admin] PATH_INFO: `/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/a7ffdfa226444449817acbcccb0b1c10/roles/2d13d41360794cff9c85249999f92061` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-4b5ea3e7-521c-4af7-9e17-6a0b1ff91090 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:26:02.201055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:02.202356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:02.203799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:26:02.203799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:26:02.203799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:26:02.203799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:26:02.203799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:26:02.203799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:26:02.203799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:02.203799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:02.203799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 288/575] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:02.203799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ea3e7-521c-4af7-9e17-6a0b1ff91090 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:02.206527 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:02.214641 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7328cd-7111-45d2-b366-d8284e093bd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=947f199ed73148beb3a4ecbc82cded19, user_id=a7ffdfa226444449817acbcccb0b1c10, role_id=2d13d41360794cff9c85249999f92061)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:02.216165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7328cd-7111-45d2-b366-d8284e093bd7 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:02.307702 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 288/576] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:26:02 2022] PUT /identity/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/a7ffdfa226444449817acbcccb0b1c10/roles/2d13d41360794cff9c85249999f92061 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:26:02.309563 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7328cd-7111-45d2-b366-d8284e093bd7 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:02.328584 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ea3e7-521c-4af7-9e17-6a0b1ff91090 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:02.380558 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c991-dc64-4a5c-8020-daa05ef9f84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:02.381224 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c991-dc64-4a5c-8020-daa05ef9f84a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:02.381643 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c991-dc64-4a5c-8020-daa05ef9f84a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:02.381925 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c991-dc64-4a5c-8020-daa05ef9f84a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:02.398738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74c991-dc64-4a5c-8020-daa05ef9f84a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:02.400484 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74c991-dc64-4a5c-8020-daa05ef9f84a None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-5c74c991-dc64-4a5c-8020-daa05ef9f84a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:02.418214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:02.419260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:02.427599 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:02.427599 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:02.427599 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:02.427599 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 289/577] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:02.427599 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c991-dc64-4a5c-8020-daa05ef9f84a None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:02.459870 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7328cd-7111-45d2-b366-d8284e093bd7 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:02.500736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3d640-3a63-47eb-be86-22dbbb1008cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:02.501448 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3d640-3a63-47eb-be86-22dbbb1008cf None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:02.501861 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3d640-3a63-47eb-be86-22dbbb1008cf None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:02.502139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3d640-3a63-47eb-be86-22dbbb1008cf None admin] PATH_INFO: `/v3/projects` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:02.502845 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3d640-3a63-47eb-be86-22dbbb1008cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:02.503161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3d640-3a63-47eb-be86-22dbbb1008cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:02.504799 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3d640-3a63-47eb-be86-22dbbb1008cf None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:02.513882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:02.523324 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 289/578] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:02.529482 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3d640-3a63-47eb-be86-22dbbb1008cf None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:02.572889 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c991-dc64-4a5c-8020-daa05ef9f84a None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:02.581218 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:02.613143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ee021-580a-4c95-8e7b-923912bdbfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:02.613814 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ee021-580a-4c95-8e7b-923912bdbfb3 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:02.614092 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ee021-580a-4c95-8e7b-923912bdbfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:02.614363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ee021-580a-4c95-8e7b-923912bdbfb3 None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:02.615012 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ee021-580a-4c95-8e7b-923912bdbfb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:02.615392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ee021-580a-4c95-8e7b-923912bdbfb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:02.616890 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ee021-580a-4c95-8e7b-923912bdbfb3 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:02.631853 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 290/579] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:02.638025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ee021-580a-4c95-8e7b-923912bdbfb3 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:02.681069 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3d640-3a63-47eb-be86-22dbbb1008cf None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:02.719818 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9a707-9a58-4b98-a1c0-573c8f0889e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:02.720834 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9a707-9a58-4b98-a1c0-573c8f0889e6 None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:02.721121 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9a707-9a58-4b98-a1c0-573c8f0889e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:02.721401 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9a707-9a58-4b98-a1c0-573c8f0889e6 None admin] PATH_INFO: `/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/0e1b4d1056614edea1585de5e531ed96/roles/2d13d41360794cff9c85249999f92061` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:02.741750 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ee021-580a-4c95-8e7b-923912bdbfb3 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:02.741950 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9a707-9a58-4b98-a1c0-573c8f0889e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=947f199ed73148beb3a4ecbc82cded19, user_id=0e1b4d1056614edea1585de5e531ed96, role_id=2d13d41360794cff9c85249999f92061)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:02.743443 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9a707-9a58-4b98-a1c0-573c8f0889e6 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:02.765675 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:02.790509 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2782b-3893-4174-8de7-27bf080ebd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:02.791148 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2782b-3893-4174-8de7-27bf080ebd23 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:02.791472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2782b-3893-4174-8de7-27bf080ebd23 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:02.791750 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2782b-3893-4174-8de7-27bf080ebd23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:02.799113 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2782b-3893-4174-8de7-27bf080ebd23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:02.800643 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2782b-3893-4174-8de7-27bf080ebd23 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-7dd2782b-3893-4174-8de7-27bf080ebd23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:26:02.813087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:02.814102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:02.815623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:26:02.815623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:26:02.815623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:26:02.815623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:26:02.815623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:26:02.815623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:26:02.815623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:02.815623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:02.815623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 291/580] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:02.819723 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2782b-3893-4174-8de7-27bf080ebd23 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:02.867264 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 290/581] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:26:02 2022] PUT /identity/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/0e1b4d1056614edea1585de5e531ed96/roles/2d13d41360794cff9c85249999f92061 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:26:02.971293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2782b-3893-4174-8de7-27bf080ebd23 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:03.012879 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330276e-e283-45d5-99c2-7a63119b7eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:03.013503 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330276e-e283-45d5-99c2-7a63119b7eb7 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:03.013787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330276e-e283-45d5-99c2-7a63119b7eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:03.014064 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330276e-e283-45d5-99c2-7a63119b7eb7 None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:03.014768 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330276e-e283-45d5-99c2-7a63119b7eb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:03.015122 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330276e-e283-45d5-99c2-7a63119b7eb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:03.016782 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330276e-e283-45d5-99c2-7a63119b7eb7 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:03.031687 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 292/582] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:03.037512 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9a707-9a58-4b98-a1c0-573c8f0889e6 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:03.138052 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:03.153421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9a707-9a58-4b98-a1c0-573c8f0889e6 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:03.189685 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b323aa-f3c3-4735-a652-4ec9b06fdce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:03.190352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b323aa-f3c3-4735-a652-4ec9b06fdce7 None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:03.190625 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b323aa-f3c3-4735-a652-4ec9b06fdce7 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:03.190894 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b323aa-f3c3-4735-a652-4ec9b06fdce7 None admin] PATH_INFO: `/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/74e4ab73defe45cb90e60e5719c5d0fe/roles/2d13d41360794cff9c85249999f92061` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:03.205712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b323aa-f3c3-4735-a652-4ec9b06fdce7 None admin] RBAC: Authorizing `identity:create_grant(project_id=947f199ed73148beb3a4ecbc82cded19, user_id=74e4ab73defe45cb90e60e5719c5d0fe, role_id=2d13d41360794cff9c85249999f92061)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:03.207294 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b323aa-f3c3-4735-a652-4ec9b06fdce7 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:03.286227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 291/583] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:26:03 2022] PUT /identity/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/74e4ab73defe45cb90e60e5719c5d0fe/roles/2d13d41360794cff9c85249999f92061 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:26:04.125080 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f6c9-7154-4151-80bd-5aebf7a01da9 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:04.125663 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f6c9-7154-4151-80bd-5aebf7a01da9 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:04.125897 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f6c9-7154-4151-80bd-5aebf7a01da9 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:04.127666 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 293/584] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:04.133267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc428ed8-c6fa-41f2-8b87-2d04a9f0bda6 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:04.133718 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc428ed8-c6fa-41f2-8b87-2d04a9f0bda6 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:04.134011 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc428ed8-c6fa-41f2-8b87-2d04a9f0bda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:04.153170 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-dc428ed8-c6fa-41f2-8b87-2d04a9f0bda6 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:04.154379 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-dc428ed8-c6fa-41f2-8b87-2d04a9f0bda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:04.226540 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 292/585] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:26:04.568805 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14f6c9-7154-4151-80bd-5aebf7a01da9 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:04.617357 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:04.676701 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffafcc1-2a04-4465-ab39-e47513f09670 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:04.676934 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffafcc1-2a04-4465-ab39-e47513f09670 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:04.677156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffafcc1-2a04-4465-ab39-e47513f09670 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:04.678810 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 293/586] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:04.684429 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2a3fa-3f41-400a-936a-a0e77856fe37 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:04.684724 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2a3fa-3f41-400a-936a-a0e77856fe37 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:04.684979 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2a3fa-3f41-400a-936a-a0e77856fe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:04.697356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14f6c9-7154-4151-80bd-5aebf7a01da9 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:04.703987 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-27d2a3fa-3f41-400a-936a-a0e77856fe37 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:04.705353 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-27d2a3fa-3f41-400a-936a-a0e77856fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:04.738055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dd555-c681-42a5-81c5-36e3d5480d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:04.738854 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dd555-c681-42a5-81c5-36e3d5480d3b None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:04.739136 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dd555-c681-42a5-81c5-36e3d5480d3b None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:04.739441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dd555-c681-42a5-81c5-36e3d5480d3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:04.754111 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dd555-c681-42a5-81c5-36e3d5480d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-e26dd555-c681-42a5-81c5-36e3d5480d3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:26:04.759813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:04.761499 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:04.762437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:04.762437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:04.762437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:04.762437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:04.762437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:26:04.762437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:26:04.762437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:26:04.762437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:26:04.762437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:26:04.762437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:26:04.762437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:26:04.762437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:04.762437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 294/587] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:26:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:04.769349 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dd555-c681-42a5-81c5-36e3d5480d3b None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:04.788028 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:04.799310 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 294/588] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:26:04.884781 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:04.892619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dd555-c681-42a5-81c5-36e3d5480d3b None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:04.930309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577169e8-ceb0-4e75-9685-f59d94eb9ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:04.931257 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577169e8-ceb0-4e75-9685-f59d94eb9ece None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:04.931722 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577169e8-ceb0-4e75-9685-f59d94eb9ece None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:04.932209 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577169e8-ceb0-4e75-9685-f59d94eb9ece None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:04.933573 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577169e8-ceb0-4e75-9685-f59d94eb9ece None admin] RBAC: Adding query filter params (name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:04.934057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577169e8-ceb0-4e75-9685-f59d94eb9ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:04.935751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577169e8-ceb0-4e75-9685-f59d94eb9ece None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:04.944991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 295/589] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:26:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:04.952371 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2a3fa-3f41-400a-936a-a0e77856fe37 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:05.065417 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2a3fa-3f41-400a-936a-a0e77856fe37 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:05.103033 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec05b1-d415-4fa5-8457-c6508762e0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:05.104043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec05b1-d415-4fa5-8457-c6508762e0ae None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:05.105106 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec05b1-d415-4fa5-8457-c6508762e0ae None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:05.105609 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec05b1-d415-4fa5-8457-c6508762e0ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:05.118630 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec05b1-d415-4fa5-8457-c6508762e0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:05.121119 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec05b1-d415-4fa5-8457-c6508762e0ae None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-d7ec05b1-d415-4fa5-8457-c6508762e0ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:05.140057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:05.141455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:05.142521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:05.142521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:05.142521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:05.144452 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 295/590] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:05.153109 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577169e8-ceb0-4e75-9685-f59d94eb9ece None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:05.156797 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec05b1-d415-4fa5-8457-c6508762e0ae None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:05.224872 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:05.273032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577169e8-ceb0-4e75-9685-f59d94eb9ece None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:05.295496 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec05b1-d415-4fa5-8457-c6508762e0ae None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:05.312288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480d5d4-078c-4551-9485-19256d21a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:05.312892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480d5d4-078c-4551-9485-19256d21a5af None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:05.313427 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480d5d4-078c-4551-9485-19256d21a5af None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:05.313704 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480d5d4-078c-4551-9485-19256d21a5af None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:05.314832 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480d5d4-078c-4551-9485-19256d21a5af None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:05.315139 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480d5d4-078c-4551-9485-19256d21a5af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:05.317070 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480d5d4-078c-4551-9485-19256d21a5af None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:05.338489 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835d0c8-2a11-476c-9cf5-e96297b20b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:05.339961 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835d0c8-2a11-476c-9cf5-e96297b20b27 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:05.340316 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835d0c8-2a11-476c-9cf5-e96297b20b27 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:05.340655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835d0c8-2a11-476c-9cf5-e96297b20b27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:05.340998 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 296/591] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:05.341912 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480d5d4-078c-4551-9485-19256d21a5af None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:05.359177 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835d0c8-2a11-476c-9cf5-e96297b20b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-5835d0c8-2a11-476c-9cf5-e96297b20b27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:26:05.364664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:05.366565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:05.367866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:05.367866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:05.367866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:05.367866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:05.367866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:26:05.367866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:26:05.367866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:26:05.367866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:26:05.367866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:26:05.367866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:26:05.367866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:26:05.367866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:05.368712 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:05.368800 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 296/592] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:26:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:05.376803 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835d0c8-2a11-476c-9cf5-e96297b20b27 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:05.478744 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480d5d4-078c-4551-9485-19256d21a5af None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:05.520781 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835d0c8-2a11-476c-9cf5-e96297b20b27 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:05.524223 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0d3b2-0038-42aa-8358-aad19a8df544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:05.524223 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0d3b2-0038-42aa-8358-aad19a8df544 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:05.524561 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0d3b2-0038-42aa-8358-aad19a8df544 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:05.524991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0d3b2-0038-42aa-8358-aad19a8df544 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:05.533399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:05.536762 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0d3b2-0038-42aa-8358-aad19a8df544 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:05.538283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0d3b2-0038-42aa-8358-aad19a8df544 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-72b0d3b2-0038-42aa-8358-aad19a8df544 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:26:05.557316 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:05.558363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:05.559331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:05.559331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:05.559331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:26:05.559331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:26:05.559331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:26:05.559331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:26:05.559331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:26:05.559331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:26:05.559331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:26:05.559331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:05.559331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 297/593] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Aug 23 16:26:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:05.559972 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9c006-8292-42c0-9946-2b7dbac2c470 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:05.560576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9c006-8292-42c0-9946-2b7dbac2c470 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:05.560576 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9c006-8292-42c0-9946-2b7dbac2c470 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:05.561984 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 298/594] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:05.564390 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9c006-8292-42c0-9946-2b7dbac2c470 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:05.573575 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2dbf2-89cd-4ab7-a6be-b1830237ffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:05.574197 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2dbf2-89cd-4ab7-a6be-b1830237ffd0 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:05.574478 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2dbf2-89cd-4ab7-a6be-b1830237ffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:05.575401 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2dbf2-89cd-4ab7-a6be-b1830237ffd0 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:05.576083 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2dbf2-89cd-4ab7-a6be-b1830237ffd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:05.576392 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2dbf2-89cd-4ab7-a6be-b1830237ffd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:05.578188 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2dbf2-89cd-4ab7-a6be-b1830237ffd0 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:05.587599 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 297/595] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:26:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:05.594186 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb915e-c4c6-4fd7-83d1-829d6891cebc None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:05.594471 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb915e-c4c6-4fd7-83d1-829d6891cebc None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:05.594785 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb915e-c4c6-4fd7-83d1-829d6891cebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:05.613765 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-c9bb915e-c4c6-4fd7-83d1-829d6891cebc None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:05.614980 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-c9bb915e-c4c6-4fd7-83d1-829d6891cebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:05.658095 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:05.684221 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9c006-8292-42c0-9946-2b7dbac2c470 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:05.689552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 298/596] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:26:05.690596 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb915e-c4c6-4fd7-83d1-829d6891cebc None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:05.720071 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513107f-7130-4a95-a5be-a6e351ff903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:05.720859 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513107f-7130-4a95-a5be-a6e351ff903e None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:05.721143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513107f-7130-4a95-a5be-a6e351ff903e None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:05.721410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513107f-7130-4a95-a5be-a6e351ff903e None admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:05.722132 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513107f-7130-4a95-a5be-a6e351ff903e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:05.722433 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513107f-7130-4a95-a5be-a6e351ff903e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:05.723895 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513107f-7130-4a95-a5be-a6e351ff903e None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:05.742607 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 299/597] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Aug 23 16:26:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:05.744178 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5caf-08b5-49ae-ae99-ff592a84558d None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:05.744512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5caf-08b5-49ae-ae99-ff592a84558d None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:05.744838 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5caf-08b5-49ae-ae99-ff592a84558d None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:05.746141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 300/598] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:05.751745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c5caf-08b5-49ae-ae99-ff592a84558d None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:05.821706 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:05.824555 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb915e-c4c6-4fd7-83d1-829d6891cebc None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:05.859619 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccd08b-6cd0-4e62-bedd-6ddaf030916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:05.860243 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccd08b-6cd0-4e62-bedd-6ddaf030916b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:05.860517 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccd08b-6cd0-4e62-bedd-6ddaf030916b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:05.860782 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccd08b-6cd0-4e62-bedd-6ddaf030916b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:05.863372 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c5caf-08b5-49ae-ae99-ff592a84558d None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:05.872089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccd08b-6cd0-4e62-bedd-6ddaf030916b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:05.873549 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccd08b-6cd0-4e62-bedd-6ddaf030916b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-7fccd08b-6cd0-4e62-bedd-6ddaf030916b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:05.892613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:05.893806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:05.894721 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:05.894721 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:05.894721 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:05.894721 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 299/599] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:05.895277 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cd521-4942-4132-80ab-e35303b4c82a None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:05.895531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cd521-4942-4132-80ab-e35303b4c82a None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:05.895801 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cd521-4942-4132-80ab-e35303b4c82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:05.909952 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958d993-dcc2-4166-ac3b-0f67c9d04029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:05.910568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958d993-dcc2-4166-ac3b-0f67c9d04029 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:05.910845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958d993-dcc2-4166-ac3b-0f67c9d04029 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:05.911120 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958d993-dcc2-4166-ac3b-0f67c9d04029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:05.913866 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:05.916130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-af1cd521-4942-4132-80ab-e35303b4c82a None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:05.917423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-af1cd521-4942-4132-80ab-e35303b4c82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:05.989765 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958d993-dcc2-4166-ac3b-0f67c9d04029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:05.991219 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958d993-dcc2-4166-ac3b-0f67c9d04029 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:06.003341 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 300/600] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:26:06.003341 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cd521-4942-4132-80ab-e35303b4c82a None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:06.100689 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:06.117026 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 301/601] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:26:06.117885 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958d993-dcc2-4166-ac3b-0f67c9d04029 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:06.120762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cd521-4942-4132-80ab-e35303b4c82a None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:06.155937 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:06.158058 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e6b53-0479-4f1d-aed0-3d5467ba2b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:06.158728 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6b53-0479-4f1d-aed0-3d5467ba2b0a None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:06.159006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6b53-0479-4f1d-aed0-3d5467ba2b0a None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:06.159302 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6b53-0479-4f1d-aed0-3d5467ba2b0a None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:06.159942 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e6b53-0479-4f1d-aed0-3d5467ba2b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:06.160278 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e6b53-0479-4f1d-aed0-3d5467ba2b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:06.161713 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e6b53-0479-4f1d-aed0-3d5467ba2b0a None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:06.173584 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 301/602] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:06.174214 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e6b53-0479-4f1d-aed0-3d5467ba2b0a None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:06.229338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958d993-dcc2-4166-ac3b-0f67c9d04029 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:06.265568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855ab2c-49ad-4c6d-968e-e7bf60ad057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:06.266116 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855ab2c-49ad-4c6d-968e-e7bf60ad057f None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:06.266395 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855ab2c-49ad-4c6d-968e-e7bf60ad057f None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:06.266668 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855ab2c-49ad-4c6d-968e-e7bf60ad057f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:06.277696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855ab2c-49ad-4c6d-968e-e7bf60ad057f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-7855ab2c-49ad-4c6d-968e-e7bf60ad057f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:26:06.282376 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:06.283360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:06.284228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:06.284228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:06.284228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:06.284228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:06.284228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:26:06.284228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:26:06.284228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:26:06.284228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:26:06.284228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:26:06.284228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:26:06.284228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:26:06.284228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:06.284228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 302/603] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:26:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:06.284904 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855ab2c-49ad-4c6d-968e-e7bf60ad057f None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:06.290887 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e6b53-0479-4f1d-aed0-3d5467ba2b0a None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:06.331110 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e6ba8-af0d-468f-8487-5d8248705349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:06.332188 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e6ba8-af0d-468f-8487-5d8248705349 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:06.332461 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e6ba8-af0d-468f-8487-5d8248705349 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:06.332733 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e6ba8-af0d-468f-8487-5d8248705349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:06.343785 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e6ba8-af0d-468f-8487-5d8248705349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:06.345267 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e6ba8-af0d-468f-8487-5d8248705349 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:06.347328 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-289e6ba8-af0d-468f-8487-5d8248705349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:06.361441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:06.365636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:06.366510 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:06.366510 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:06.366510 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:06.366510 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 302/604] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:06.366510 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e6ba8-af0d-468f-8487-5d8248705349 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:06.397213 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:06.404797 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855ab2c-49ad-4c6d-968e-e7bf60ad057f None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:06.440920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d9f7e-69db-4659-b68c-1a35a8adf13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:06.441551 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d9f7e-69db-4659-b68c-1a35a8adf13d None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:06.441830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d9f7e-69db-4659-b68c-1a35a8adf13d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:06.442097 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d9f7e-69db-4659-b68c-1a35a8adf13d None admin] PATH_INFO: `/v3/users/glance` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:06.450029 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d9f7e-69db-4659-b68c-1a35a8adf13d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:06.451563 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d9f7e-69db-4659-b68c-1a35a8adf13d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-346d9f7e-69db-4659-b68c-1a35a8adf13d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:26:06.462899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:06.464158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:06.465084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:06.465084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:06.465084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:26:06.465084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:26:06.465084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:26:06.465084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:26:06.465084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:26:06.465084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:26:06.465084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:26:06.465084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:06.465084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 303/605] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:26:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:06.465084 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d9f7e-69db-4659-b68c-1a35a8adf13d None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:06.474062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e6ba8-af0d-468f-8487-5d8248705349 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:06.507941 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7454ccf-d248-415f-8c7c-3dd48d155e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:06.508549 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7454ccf-d248-415f-8c7c-3dd48d155e91 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:06.508839 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7454ccf-d248-415f-8c7c-3dd48d155e91 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:06.509104 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7454ccf-d248-415f-8c7c-3dd48d155e91 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:06.509765 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7454ccf-d248-415f-8c7c-3dd48d155e91 None admin] RBAC: Adding query filter params (name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:06.510069 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7454ccf-d248-415f-8c7c-3dd48d155e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:06.512136 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7454ccf-d248-415f-8c7c-3dd48d155e91 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:06.520667 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 303/606] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:26:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:06.521442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7454ccf-d248-415f-8c7c-3dd48d155e91 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:06.577486 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d9f7e-69db-4659-b68c-1a35a8adf13d None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:06.577745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:06.612324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b078d09-10a2-424f-a5bf-7eb0b69ce214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:06.612954 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078d09-10a2-424f-a5bf-7eb0b69ce214 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:06.613229 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078d09-10a2-424f-a5bf-7eb0b69ce214 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:06.613497 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078d09-10a2-424f-a5bf-7eb0b69ce214 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:06.621907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7454ccf-d248-415f-8c7c-3dd48d155e91 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:06.624192 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b078d09-10a2-424f-a5bf-7eb0b69ce214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-5b078d09-10a2-424f-a5bf-7eb0b69ce214 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:26:06.629264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:06.630205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 304/607] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:26:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:06.631537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b078d09-10a2-424f-a5bf-7eb0b69ce214 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:06.651572 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:06.660818 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab98b6-11fc-4fbf-9483-7f061c6a078b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:06.661434 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab98b6-11fc-4fbf-9483-7f061c6a078b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:06.661714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab98b6-11fc-4fbf-9483-7f061c6a078b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:06.664361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab98b6-11fc-4fbf-9483-7f061c6a078b None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:06.664361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab98b6-11fc-4fbf-9483-7f061c6a078b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:06.664361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab98b6-11fc-4fbf-9483-7f061c6a078b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:06.664614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab98b6-11fc-4fbf-9483-7f061c6a078b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:06.680460 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 304/608] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:06.681317 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab98b6-11fc-4fbf-9483-7f061c6a078b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:06.746547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b078d09-10a2-424f-a5bf-7eb0b69ce214 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:06.781903 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b84ab-5e48-4e60-81f3-cb516a7850bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:06.782508 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b84ab-5e48-4e60-81f3-cb516a7850bd None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:06.782788 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b84ab-5e48-4e60-81f3-cb516a7850bd None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:06.783059 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b84ab-5e48-4e60-81f3-cb516a7850bd None admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:06.783843 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b84ab-5e48-4e60-81f3-cb516a7850bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:06.784133 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b84ab-5e48-4e60-81f3-cb516a7850bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:06.785566 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b84ab-5e48-4e60-81f3-cb516a7850bd None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:06.789796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab98b6-11fc-4fbf-9483-7f061c6a078b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:06.803289 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 305/609] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Aug 23 16:26:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:06.804204 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b84ab-5e48-4e60-81f3-cb516a7850bd None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:06.808971 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:06.826633 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f29198-d0fb-4885-a39c-307e24f51c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:06.827281 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f29198-d0fb-4885-a39c-307e24f51c43 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:06.827566 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f29198-d0fb-4885-a39c-307e24f51c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:06.827824 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f29198-d0fb-4885-a39c-307e24f51c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:06.837839 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f29198-d0fb-4885-a39c-307e24f51c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:06.839320 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f29198-d0fb-4885-a39c-307e24f51c43 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-21f29198-d0fb-4885-a39c-307e24f51c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:06.853409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:06.855088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:06.856270 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:06.856270 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:06.856270 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:06.856270 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 305/610] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:06.856270 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f29198-d0fb-4885-a39c-307e24f51c43 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:06.878172 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:06.908755 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b84ab-5e48-4e60-81f3-cb516a7850bd None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:06.945103 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812467a-c810-4341-ab3c-40b1a2d96393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:06.945704 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812467a-c810-4341-ab3c-40b1a2d96393 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:06.945981 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812467a-c810-4341-ab3c-40b1a2d96393 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:06.946250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812467a-c810-4341-ab3c-40b1a2d96393 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:06.946909 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812467a-c810-4341-ab3c-40b1a2d96393 None admin] RBAC: Adding query filter params (name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:06.947207 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812467a-c810-4341-ab3c-40b1a2d96393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:06.948587 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812467a-c810-4341-ab3c-40b1a2d96393 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:06.954991 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f29198-d0fb-4885-a39c-307e24f51c43 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:06.956603 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 306/611] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:26:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:06.957419 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812467a-c810-4341-ab3c-40b1a2d96393 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:06.997844 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0c7c0-779d-41c0-aa75-ec0f15b207ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:06.998843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0c7c0-779d-41c0-aa75-ec0f15b207ab None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:06.999200 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0c7c0-779d-41c0-aa75-ec0f15b207ab None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:06.999608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0c7c0-779d-41c0-aa75-ec0f15b207ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:07.007188 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0c7c0-779d-41c0-aa75-ec0f15b207ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:07.008713 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0c7c0-779d-41c0-aa75-ec0f15b207ab None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-d0a0c7c0-779d-41c0-aa75-ec0f15b207ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:26:07.022239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:07.023531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:07.024422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:26:07.024422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:26:07.024422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:26:07.024422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:26:07.024422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:26:07.024422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:26:07.024422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:07.024422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:07.024422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 306/612] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:07.024917 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0c7c0-779d-41c0-aa75-ec0f15b207ab None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:07.055430 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:07.068963 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812467a-c810-4341-ab3c-40b1a2d96393 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:07.103450 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bceb9-7e39-4d46-921b-fef3dacca71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:07.104070 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bceb9-7e39-4d46-921b-fef3dacca71c None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:07.104932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bceb9-7e39-4d46-921b-fef3dacca71c None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:07.105209 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bceb9-7e39-4d46-921b-fef3dacca71c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:07.107864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:07.127979 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0c7c0-779d-41c0-aa75-ec0f15b207ab None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:07.164463 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988e8eb-4bbc-42bd-8c9b-ab9dd45dd0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:07.165126 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e8eb-4bbc-42bd-8c9b-ab9dd45dd0f3 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:07.165373 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e8eb-4bbc-42bd-8c9b-ab9dd45dd0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:07.165652 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e8eb-4bbc-42bd-8c9b-ab9dd45dd0f3 None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:07.166311 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988e8eb-4bbc-42bd-8c9b-ab9dd45dd0f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:07.166620 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988e8eb-4bbc-42bd-8c9b-ab9dd45dd0f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:07.168596 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988e8eb-4bbc-42bd-8c9b-ab9dd45dd0f3 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:07.180957 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 307/613] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:07.181701 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988e8eb-4bbc-42bd-8c9b-ab9dd45dd0f3 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:07.182209 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bceb9-7e39-4d46-921b-fef3dacca71c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:07.183864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bceb9-7e39-4d46-921b-fef3dacca71c None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:07.269298 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:07.281669 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988e8eb-4bbc-42bd-8c9b-ab9dd45dd0f3 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:07.284531 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 307/614] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:26:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:26:07.285388 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bceb9-7e39-4d46-921b-fef3dacca71c None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:07.317863 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1544bef-73fc-435a-b935-ef292249e528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:07.318492 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544bef-73fc-435a-b935-ef292249e528 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:07.318768 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544bef-73fc-435a-b935-ef292249e528 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:07.319038 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544bef-73fc-435a-b935-ef292249e528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:07.320183 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:07.329321 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1544bef-73fc-435a-b935-ef292249e528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:07.330837 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1544bef-73fc-435a-b935-ef292249e528 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-c1544bef-73fc-435a-b935-ef292249e528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:07.346796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:07.352139 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:07.353187 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:07.353187 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:07.353187 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:07.353187 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 308/615] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:07.353187 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1544bef-73fc-435a-b935-ef292249e528 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:07.394978 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bceb9-7e39-4d46-921b-fef3dacca71c None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:07.430682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463eeb9-e5d7-4b6b-b1b2-ba2733a5cb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:07.431633 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463eeb9-e5d7-4b6b-b1b2-ba2733a5cb3a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:07.432093 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463eeb9-e5d7-4b6b-b1b2-ba2733a5cb3a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:07.432363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463eeb9-e5d7-4b6b-b1b2-ba2733a5cb3a None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:07.433056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463eeb9-e5d7-4b6b-b1b2-ba2733a5cb3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:07.433360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463eeb9-e5d7-4b6b-b1b2-ba2733a5cb3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:07.434887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463eeb9-e5d7-4b6b-b1b2-ba2733a5cb3a None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:07.446651 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 308/616] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:07.447411 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463eeb9-e5d7-4b6b-b1b2-ba2733a5cb3a None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:07.461535 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1544bef-73fc-435a-b935-ef292249e528 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:07.495294 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed1f6c-50fd-45a7-be4e-fcd44d8fd403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:07.495928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed1f6c-50fd-45a7-be4e-fcd44d8fd403 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:07.496204 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed1f6c-50fd-45a7-be4e-fcd44d8fd403 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:07.496472 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed1f6c-50fd-45a7-be4e-fcd44d8fd403 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:07.504051 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed1f6c-50fd-45a7-be4e-fcd44d8fd403 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:07.505576 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed1f6c-50fd-45a7-be4e-fcd44d8fd403 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:07.508147 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-b6ed1f6c-50fd-45a7-be4e-fcd44d8fd403 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:26:07.517357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:07.524537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:07.525742 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:07.525742 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:07.525742 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:26:07.525742 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:26:07.525742 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:26:07.525742 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:26:07.525742 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:26:07.525742 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:26:07.525742 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:26:07.525742 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:07.525742 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 309/617] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:26:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:07.525742 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed1f6c-50fd-45a7-be4e-fcd44d8fd403 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:07.544989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:07.551800 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463eeb9-e5d7-4b6b-b1b2-ba2733a5cb3a None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:07.586719 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdf4fb-0e67-4933-9e9a-bca4d8cbc71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:07.587386 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdf4fb-0e67-4933-9e9a-bca4d8cbc71d None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:07.587917 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdf4fb-0e67-4933-9e9a-bca4d8cbc71d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:07.589167 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdf4fb-0e67-4933-9e9a-bca4d8cbc71d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:07.599894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdf4fb-0e67-4933-9e9a-bca4d8cbc71d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:07.601349 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdf4fb-0e67-4933-9e9a-bca4d8cbc71d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-50bdf4fb-0e67-4933-9e9a-bca4d8cbc71d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:07.615727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:07.616887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:07.617857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:07.617857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:07.617857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:07.617857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 309/618] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:07.617857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdf4fb-0e67-4933-9e9a-bca4d8cbc71d None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:07.624972 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed1f6c-50fd-45a7-be4e-fcd44d8fd403 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:07.659056 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be59ff-08ba-41ac-af0f-7acc3fe64203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:07.659695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be59ff-08ba-41ac-af0f-7acc3fe64203 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:07.659973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be59ff-08ba-41ac-af0f-7acc3fe64203 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:07.660243 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be59ff-08ba-41ac-af0f-7acc3fe64203 None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:07.660875 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be59ff-08ba-41ac-af0f-7acc3fe64203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:07.661176 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be59ff-08ba-41ac-af0f-7acc3fe64203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:07.662522 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be59ff-08ba-41ac-af0f-7acc3fe64203 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:07.674168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 310/619] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:07.674985 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be59ff-08ba-41ac-af0f-7acc3fe64203 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:07.719953 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdf4fb-0e67-4933-9e9a-bca4d8cbc71d None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:07.734255 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:07.754979 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69b399-68c7-4cc7-8c71-48f11a612252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:07.755628 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69b399-68c7-4cc7-8c71-48f11a612252 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:07.755912 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69b399-68c7-4cc7-8c71-48f11a612252 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:07.756188 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69b399-68c7-4cc7-8c71-48f11a612252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:07.756922 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69b399-68c7-4cc7-8c71-48f11a612252 None admin] RBAC: Adding query filter params (role.id=2d13d41360794cff9c85249999f92061, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=db2c2345bf6e487bb3451fd6ce17f67f) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:07.757235 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69b399-68c7-4cc7-8c71-48f11a612252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:07.758679 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69b399-68c7-4cc7-8c71-48f11a612252 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:07.765035 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 310/620] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:26:07 2022] GET /identity/v3/role_assignments?user.id=db2c2345bf6e487bb3451fd6ce17f67f&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=2d13d41360794cff9c85249999f92061 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:07.765930 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69b399-68c7-4cc7-8c71-48f11a612252 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:07.775617 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be59ff-08ba-41ac-af0f-7acc3fe64203 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:07.793448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:07.817664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb8209-ef2e-4525-9ea7-d967c0f58b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:07.818568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb8209-ef2e-4525-9ea7-d967c0f58b11 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:07.818999 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb8209-ef2e-4525-9ea7-d967c0f58b11 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:07.819459 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb8209-ef2e-4525-9ea7-d967c0f58b11 None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:07.820350 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb8209-ef2e-4525-9ea7-d967c0f58b11 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:07.820848 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb8209-ef2e-4525-9ea7-d967c0f58b11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:07.822353 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb8209-ef2e-4525-9ea7-d967c0f58b11 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:07.849685 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 311/621] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Aug 23 16:26:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:07.850963 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb8209-ef2e-4525-9ea7-d967c0f58b11 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:07.900309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69b399-68c7-4cc7-8c71-48f11a612252 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:07.940135 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275740e0-c18a-417c-9d01-7b82682aecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:07.940758 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275740e0-c18a-417c-9d01-7b82682aecec None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:07.941037 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275740e0-c18a-417c-9d01-7b82682aecec None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:07.941312 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275740e0-c18a-417c-9d01-7b82682aecec None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:07.941992 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275740e0-c18a-417c-9d01-7b82682aecec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:07.942295 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275740e0-c18a-417c-9d01-7b82682aecec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:07.943780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275740e0-c18a-417c-9d01-7b82682aecec None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:07.958936 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 311/622] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:07.959875 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275740e0-c18a-417c-9d01-7b82682aecec None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:07.979390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb8209-ef2e-4525-9ea7-d967c0f58b11 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:08.003339 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:08.031114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932323d-15aa-48bf-8931-6537ebccebcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:08.031909 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932323d-15aa-48bf-8931-6537ebccebcd None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:08.032185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932323d-15aa-48bf-8931-6537ebccebcd None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:08.032453 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932323d-15aa-48bf-8931-6537ebccebcd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:08.041819 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932323d-15aa-48bf-8931-6537ebccebcd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:08.043464 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932323d-15aa-48bf-8931-6537ebccebcd None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-a932323d-15aa-48bf-8931-6537ebccebcd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:26:08.055745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:08.056786 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:08.058306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:08.058306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:08.058306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:26:08.058306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:26:08.058306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:26:08.058306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:26:08.058306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:26:08.058306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:26:08.058306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:26:08.058306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:08.058306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 312/623] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:26:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:08.058912 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932323d-15aa-48bf-8931-6537ebccebcd None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:08.060053 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:08.093071 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275740e0-c18a-417c-9d01-7b82682aecec None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:08.140807 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf516f38-8b84-4f3b-97d7-ea55a7f5a0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:08.141426 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516f38-8b84-4f3b-97d7-ea55a7f5a0d8 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:08.141741 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516f38-8b84-4f3b-97d7-ea55a7f5a0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:08.141984 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516f38-8b84-4f3b-97d7-ea55a7f5a0d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:08.177663 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932323d-15aa-48bf-8931-6537ebccebcd None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:08.213784 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fa329-a59f-40c4-a8c1-165958f9abf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:08.214335 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa329-a59f-40c4-a8c1-165958f9abf4 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:08.214615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa329-a59f-40c4-a8c1-165958f9abf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:08.214882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa329-a59f-40c4-a8c1-165958f9abf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:08.217938 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf516f38-8b84-4f3b-97d7-ea55a7f5a0d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:08.219419 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf516f38-8b84-4f3b-97d7-ea55a7f5a0d8 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:08.222605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fa329-a59f-40c4-a8c1-165958f9abf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:08.224071 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fa329-a59f-40c4-a8c1-165958f9abf4 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-b79fa329-a59f-40c4-a8c1-165958f9abf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:26:08.236183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:08.237127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:08.238036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:26:08.238036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:26:08.238036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:26:08.238036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:26:08.238036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:26:08.238036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:26:08.238036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:08.238036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:08.238036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 313/624] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:08.238535 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fa329-a59f-40c4-a8c1-165958f9abf4 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:08.283135 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:08.299834 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:08.337114 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 312/625] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:26:08.337114 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf516f38-8b84-4f3b-97d7-ea55a7f5a0d8 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:08.350523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fa329-a59f-40c4-a8c1-165958f9abf4 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:08.393036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a4d15-66f3-4d7c-b290-144530bc5078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:08.393648 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a4d15-66f3-4d7c-b290-144530bc5078 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:08.393935 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a4d15-66f3-4d7c-b290-144530bc5078 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:08.394212 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a4d15-66f3-4d7c-b290-144530bc5078 None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:08.394946 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a4d15-66f3-4d7c-b290-144530bc5078 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:08.395275 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a4d15-66f3-4d7c-b290-144530bc5078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:08.396710 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a4d15-66f3-4d7c-b290-144530bc5078 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:08.415078 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 314/626] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Aug 23 16:26:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:08.415925 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a4d15-66f3-4d7c-b290-144530bc5078 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:08.456813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf516f38-8b84-4f3b-97d7-ea55a7f5a0d8 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:08.493171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e418780-e54a-4597-9d93-ff5c566967d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:08.493783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e418780-e54a-4597-9d93-ff5c566967d9 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:08.494063 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e418780-e54a-4597-9d93-ff5c566967d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:08.494337 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e418780-e54a-4597-9d93-ff5c566967d9 None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:08.495076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e418780-e54a-4597-9d93-ff5c566967d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:08.495417 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e418780-e54a-4597-9d93-ff5c566967d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:08.496873 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e418780-e54a-4597-9d93-ff5c566967d9 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:08.508846 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 313/627] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:08.509698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e418780-e54a-4597-9d93-ff5c566967d9 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:08.534339 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:08.540915 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a4d15-66f3-4d7c-b290-144530bc5078 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:08.543987 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:08.577168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c33c6-6347-4868-b6e1-5556c27f8f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:08.578154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c33c6-6347-4868-b6e1-5556c27f8f17 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:08.578606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c33c6-6347-4868-b6e1-5556c27f8f17 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:08.579063 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c33c6-6347-4868-b6e1-5556c27f8f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:08.593929 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c33c6-6347-4868-b6e1-5556c27f8f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:08.596403 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c33c6-6347-4868-b6e1-5556c27f8f17 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-368c33c6-6347-4868-b6e1-5556c27f8f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:08.615361 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:08.616437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:08.617322 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:08.617322 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:08.617322 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:08.617322 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 315/628] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:08.617322 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c33c6-6347-4868-b6e1-5556c27f8f17 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:08.633220 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e418780-e54a-4597-9d93-ff5c566967d9 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:08.682509 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22349666-55f9-4002-960d-53b71ed73a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:08.683491 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22349666-55f9-4002-960d-53b71ed73a82 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:08.683797 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22349666-55f9-4002-960d-53b71ed73a82 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:08.684527 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22349666-55f9-4002-960d-53b71ed73a82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:08.736751 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c33c6-6347-4868-b6e1-5556c27f8f17 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:08.772556 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22349666-55f9-4002-960d-53b71ed73a82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:08.774091 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22349666-55f9-4002-960d-53b71ed73a82 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:08.786514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3143a2-42d4-4a25-be95-7c1fb191499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:08.787027 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3143a2-42d4-4a25-be95-7c1fb191499d None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:08.787342 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3143a2-42d4-4a25-be95-7c1fb191499d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:08.787623 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3143a2-42d4-4a25-be95-7c1fb191499d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:08.788371 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3143a2-42d4-4a25-be95-7c1fb191499d None admin] RBAC: Adding query filter params (role.id=2d13d41360794cff9c85249999f92061, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=a7ffdfa226444449817acbcccb0b1c10) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:08.788672 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3143a2-42d4-4a25-be95-7c1fb191499d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:08.790141 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3143a2-42d4-4a25-be95-7c1fb191499d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:08.797694 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 316/629] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:26:08 2022] GET /identity/v3/role_assignments?user.id=a7ffdfa226444449817acbcccb0b1c10&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=2d13d41360794cff9c85249999f92061 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:08.798417 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3143a2-42d4-4a25-be95-7c1fb191499d None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:08.818999 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:08.821802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:08.914145 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 314/630] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:26:08.919361 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22349666-55f9-4002-960d-53b71ed73a82 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:08.943901 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3143a2-42d4-4a25-be95-7c1fb191499d None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:08.986106 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cce60a-77b3-4c48-b347-aef37cec577c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:08.987312 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cce60a-77b3-4c48-b347-aef37cec577c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:08.987885 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cce60a-77b3-4c48-b347-aef37cec577c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:08.988373 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cce60a-77b3-4c48-b347-aef37cec577c None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:08.989330 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cce60a-77b3-4c48-b347-aef37cec577c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:08.989870 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cce60a-77b3-4c48-b347-aef37cec577c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:08.991557 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cce60a-77b3-4c48-b347-aef37cec577c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:09.009489 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 317/631] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:09.020796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cce60a-77b3-4c48-b347-aef37cec577c None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:09.068014 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22349666-55f9-4002-960d-53b71ed73a82 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:09.105346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:09.112490 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebd357-c68d-4533-8cdc-ff6c2dc5298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:09.113179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebd357-c68d-4533-8cdc-ff6c2dc5298a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:09.113479 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebd357-c68d-4533-8cdc-ff6c2dc5298a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:09.114547 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebd357-c68d-4533-8cdc-ff6c2dc5298a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:09.130051 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:09.130760 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebd357-c68d-4533-8cdc-ff6c2dc5298a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:09.132457 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebd357-c68d-4533-8cdc-ff6c2dc5298a None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-75ebd357-c68d-4533-8cdc-ff6c2dc5298a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:09.149169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:09.150190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:09.151753 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:09.151753 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:09.151753 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:09.153880 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 315/632] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:09.161706 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cce60a-77b3-4c48-b347-aef37cec577c None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:09.161903 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebd357-c68d-4533-8cdc-ff6c2dc5298a None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:09.195992 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544573b-fbe3-4fbd-b028-f47b4a6b24ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:09.196537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544573b-fbe3-4fbd-b028-f47b4a6b24ed None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:09.196851 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544573b-fbe3-4fbd-b028-f47b4a6b24ed None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:09.197121 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544573b-fbe3-4fbd-b028-f47b4a6b24ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:09.208443 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544573b-fbe3-4fbd-b028-f47b4a6b24ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:09.210935 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544573b-fbe3-4fbd-b028-f47b4a6b24ed None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-5544573b-fbe3-4fbd-b028-f47b4a6b24ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:26:09.226006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:09.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:09.228173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:26:09.228173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:26:09.228173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:26:09.228173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:26:09.228173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:26:09.228173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:26:09.228173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:09.228173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:09.235404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 318/633] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:09.237021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544573b-fbe3-4fbd-b028-f47b4a6b24ed None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:09.326491 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebd357-c68d-4533-8cdc-ff6c2dc5298a None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:09.356387 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544573b-fbe3-4fbd-b028-f47b4a6b24ed None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:09.393364 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65fe54-ae44-4972-9389-f7f5d741e773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:09.394923 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65fe54-ae44-4972-9389-f7f5d741e773 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:09.395774 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65fe54-ae44-4972-9389-f7f5d741e773 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:09.396259 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65fe54-ae44-4972-9389-f7f5d741e773 None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:09.397111 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65fe54-ae44-4972-9389-f7f5d741e773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:09.398075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65fe54-ae44-4972-9389-f7f5d741e773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:09.399479 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:09.401302 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65fe54-ae44-4972-9389-f7f5d741e773 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:09.408122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30a490-9916-475f-a94e-92a3f3837255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:09.409115 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a490-9916-475f-a94e-92a3f3837255 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:09.409576 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a490-9916-475f-a94e-92a3f3837255 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:09.410094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a490-9916-475f-a94e-92a3f3837255 None admin] PATH_INFO: `/v3/projects` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:09.411363 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30a490-9916-475f-a94e-92a3f3837255 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:09.412327 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30a490-9916-475f-a94e-92a3f3837255 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:09.414870 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30a490-9916-475f-a94e-92a3f3837255 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:09.418368 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 316/634] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:09.424781 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65fe54-ae44-4972-9389-f7f5d741e773 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:09.439806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 319/635] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:09.442933 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30a490-9916-475f-a94e-92a3f3837255 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:09.480406 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:09.548490 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65fe54-ae44-4972-9389-f7f5d741e773 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:09.551036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30a490-9916-475f-a94e-92a3f3837255 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:09.596235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66393-80fc-4441-a70e-906a8ed5556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:09.596848 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66393-80fc-4441-a70e-906a8ed5556b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:09.597144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66393-80fc-4441-a70e-906a8ed5556b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:09.597390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66393-80fc-4441-a70e-906a8ed5556b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:09.598115 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e66393-80fc-4441-a70e-906a8ed5556b None admin] RBAC: Adding query filter params (role.id=2d13d41360794cff9c85249999f92061, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=0e1b4d1056614edea1585de5e531ed96) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:09.598570 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e66393-80fc-4441-a70e-906a8ed5556b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:09.598767 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303b74e-d9a7-4607-bd2e-42ef2ffed3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:09.599452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303b74e-d9a7-4607-bd2e-42ef2ffed3b7 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:09.599771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303b74e-d9a7-4607-bd2e-42ef2ffed3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:09.600123 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e66393-80fc-4441-a70e-906a8ed5556b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:09.600242 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303b74e-d9a7-4607-bd2e-42ef2ffed3b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:09.609169 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 320/636] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:26:09 2022] GET /identity/v3/role_assignments?user.id=0e1b4d1056614edea1585de5e531ed96&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=2d13d41360794cff9c85249999f92061 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:09.610955 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303b74e-d9a7-4607-bd2e-42ef2ffed3b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:09.619267 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303b74e-d9a7-4607-bd2e-42ef2ffed3b7 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-9303b74e-d9a7-4607-bd2e-42ef2ffed3b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:26:09.632414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:09.633619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:09.635126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:26:09.635126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:26:09.635126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:26:09.635126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:26:09.635126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:26:09.635126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:26:09.635126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:09.635126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:09.635126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 317/637] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:09.639663 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66393-80fc-4441-a70e-906a8ed5556b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:09.710285 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:09.766397 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66393-80fc-4441-a70e-906a8ed5556b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:09.806094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d4736-9751-488a-a841-1f1628a82546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:09.806708 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d4736-9751-488a-a841-1f1628a82546 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:09.806986 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d4736-9751-488a-a841-1f1628a82546 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:09.807900 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d4736-9751-488a-a841-1f1628a82546 None admin] PATH_INFO: `/v3/projects` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:09.808594 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d4736-9751-488a-a841-1f1628a82546 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:09.808901 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d4736-9751-488a-a841-1f1628a82546 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:09.810327 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d4736-9751-488a-a841-1f1628a82546 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:09.823999 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 321/638] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:09.831823 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303b74e-d9a7-4607-bd2e-42ef2ffed3b7 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:09.944739 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303b74e-d9a7-4607-bd2e-42ef2ffed3b7 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:09.946898 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:09.987743 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3254f-ec27-422a-a9df-8a5858eb0228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:09.988377 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3254f-ec27-422a-a9df-8a5858eb0228 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:09.988660 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3254f-ec27-422a-a9df-8a5858eb0228 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:09.988934 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3254f-ec27-422a-a9df-8a5858eb0228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:09.989693 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3254f-ec27-422a-a9df-8a5858eb0228 None admin] RBAC: Adding query filter params (role.id=2d13d41360794cff9c85249999f92061, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=74e4ab73defe45cb90e60e5719c5d0fe) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:09.990005 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3254f-ec27-422a-a9df-8a5858eb0228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:09.991757 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3254f-ec27-422a-a9df-8a5858eb0228 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:10.007461 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 318/639] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:26:09 2022] GET /identity/v3/role_assignments?user.id=74e4ab73defe45cb90e60e5719c5d0fe&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=2d13d41360794cff9c85249999f92061 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:10.144319 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d8233-d171-4ff8-88f6-ebb2de9e64e2 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:10.144601 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d8233-d171-4ff8-88f6-ebb2de9e64e2 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:10.144946 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d8233-d171-4ff8-88f6-ebb2de9e64e2 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:10.146520 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 322/640] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:10.154995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa93ca-232b-47d5-965c-8b27583dcadf None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:10.155378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa93ca-232b-47d5-965c-8b27583dcadf None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:10.155660 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa93ca-232b-47d5-965c-8b27583dcadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:10.177723 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-b1fa93ca-232b-47d5-965c-8b27583dcadf None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:10.179391 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-b1fa93ca-232b-47d5-965c-8b27583dcadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:10.259674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 319/641] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:26:10.604938 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d8233-d171-4ff8-88f6-ebb2de9e64e2 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:10.712136 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d8233-d171-4ff8-88f6-ebb2de9e64e2 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:10.733490 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:10.755265 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb465c-d73d-4d1c-a1f2-259d6639f2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:10.755265 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb465c-d73d-4d1c-a1f2-259d6639f2c3 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:10.755265 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb465c-d73d-4d1c-a1f2-259d6639f2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:10.755265 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb465c-d73d-4d1c-a1f2-259d6639f2c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:10.765296 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb465c-d73d-4d1c-a1f2-259d6639f2c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-0abb465c-d73d-4d1c-a1f2-259d6639f2c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:26:10.770378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:10.771476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:10.772666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:10.772666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:10.772666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:10.772666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:10.772666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:26:10.772666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:26:10.772666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:26:10.772666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:26:10.772666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:26:10.772666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:26:10.772666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:26:10.772666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:10.772666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 323/642] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:10.778093 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa93ca-232b-47d5-965c-8b27583dcadf None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:10.884586 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa93ca-232b-47d5-965c-8b27583dcadf None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:10.893290 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:10.922006 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7319d-52a4-461c-a1db-c89b25109a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:10.922635 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7319d-52a4-461c-a1db-c89b25109a63 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:10.922956 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7319d-52a4-461c-a1db-c89b25109a63 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:10.923190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7319d-52a4-461c-a1db-c89b25109a63 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:10.923901 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7319d-52a4-461c-a1db-c89b25109a63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:10.924215 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7319d-52a4-461c-a1db-c89b25109a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:10.925627 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7319d-52a4-461c-a1db-c89b25109a63 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:10.936293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 320/643] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:26:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:10.944596 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb465c-d73d-4d1c-a1f2-259d6639f2c3 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:11.057852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb465c-d73d-4d1c-a1f2-259d6639f2c3 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:11.094976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1064d9-87f3-4f23-a7f5-f028ceffe6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:11.095627 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1064d9-87f3-4f23-a7f5-f028ceffe6d2 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:11.095901 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1064d9-87f3-4f23-a7f5-f028ceffe6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:11.096207 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1064d9-87f3-4f23-a7f5-f028ceffe6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:11.108160 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1064d9-87f3-4f23-a7f5-f028ceffe6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:11.109639 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1064d9-87f3-4f23-a7f5-f028ceffe6d2 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-5d1064d9-87f3-4f23-a7f5-f028ceffe6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:11.125444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:11.127796 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:11.129838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:11.129838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:11.129838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:11.129838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 324/644] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:11.132273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7319d-52a4-461c-a1db-c89b25109a63 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:11.247183 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7319d-52a4-461c-a1db-c89b25109a63 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:11.284874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb3e0-d5f4-4ae6-bde7-96f34866cde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:11.285500 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb3e0-d5f4-4ae6-bde7-96f34866cde4 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:11.285781 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb3e0-d5f4-4ae6-bde7-96f34866cde4 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:11.286059 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb3e0-d5f4-4ae6-bde7-96f34866cde4 None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:11.286719 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb3e0-d5f4-4ae6-bde7-96f34866cde4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:11.287029 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb3e0-d5f4-4ae6-bde7-96f34866cde4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:11.288483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb3e0-d5f4-4ae6-bde7-96f34866cde4 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:11.303827 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 321/645] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:11.309854 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1064d9-87f3-4f23-a7f5-f028ceffe6d2 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:11.343522 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:11.396867 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130da420-0cc7-40ad-a15a-b6911a523891 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:11.397753 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130da420-0cc7-40ad-a15a-b6911a523891 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:11.398325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130da420-0cc7-40ad-a15a-b6911a523891 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:11.400341 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 322/646] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:11.406885 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6c267-8fd3-4af9-b59a-5fbf4a7408e9 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:11.407529 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6c267-8fd3-4af9-b59a-5fbf4a7408e9 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:11.408009 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6c267-8fd3-4af9-b59a-5fbf4a7408e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:11.427255 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-8bf6c267-8fd3-4af9-b59a-5fbf4a7408e9 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:11.428908 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-8bf6c267-8fd3-4af9-b59a-5fbf4a7408e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:11.430762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1064d9-87f3-4f23-a7f5-f028ceffe6d2 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:11.446933 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:11.475476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387817b9-1070-4deb-a0af-872ca8f1933a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:11.476123 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387817b9-1070-4deb-a0af-872ca8f1933a None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:11.476408 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387817b9-1070-4deb-a0af-872ca8f1933a None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:11.476685 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387817b9-1070-4deb-a0af-872ca8f1933a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:11.487734 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387817b9-1070-4deb-a0af-872ca8f1933a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:11.489352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387817b9-1070-4deb-a0af-872ca8f1933a None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-387817b9-1070-4deb-a0af-872ca8f1933a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:26:11.505937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:11.506907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:11.507880 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:11.507880 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:11.507880 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:26:11.507880 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:26:11.507880 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:26:11.507880 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:26:11.507880 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:26:11.507880 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:26:11.507880 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:26:11.507880 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:11.507880 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 325/647] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Aug 23 16:26:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:11.514566 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 323/648] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:26:11.516296 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387817b9-1070-4deb-a0af-872ca8f1933a None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:11.611397 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:11.624160 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387817b9-1070-4deb-a0af-872ca8f1933a None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:11.659885 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011fc90-a14a-4229-962a-04bc9f51d06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:11.660493 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011fc90-a14a-4229-962a-04bc9f51d06e None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:11.660771 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011fc90-a14a-4229-962a-04bc9f51d06e None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:11.661043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011fc90-a14a-4229-962a-04bc9f51d06e None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:11.661778 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011fc90-a14a-4229-962a-04bc9f51d06e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:11.662085 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011fc90-a14a-4229-962a-04bc9f51d06e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:11.663544 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011fc90-a14a-4229-962a-04bc9f51d06e None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:11.687080 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 326/649] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Aug 23 16:26:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:11.694481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6c267-8fd3-4af9-b59a-5fbf4a7408e9 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:11.812081 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6c267-8fd3-4af9-b59a-5fbf4a7408e9 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:11.848616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ac23e-abe8-40bb-8f3c-746b2f03db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:11.849240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ac23e-abe8-40bb-8f3c-746b2f03db7a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:11.849521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ac23e-abe8-40bb-8f3c-746b2f03db7a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:11.849797 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ac23e-abe8-40bb-8f3c-746b2f03db7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:11.869754 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:11.874051 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011fc90-a14a-4229-962a-04bc9f51d06e None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:11.924146 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ac23e-abe8-40bb-8f3c-746b2f03db7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:11.925641 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ac23e-abe8-40bb-8f3c-746b2f03db7a None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:11.990362 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011fc90-a14a-4229-962a-04bc9f51d06e None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:12.035578 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c2445-ec8a-44d0-a0cf-4cd2c7a8d5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:12.036874 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c2445-ec8a-44d0-a0cf-4cd2c7a8d5b4 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:12.037799 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c2445-ec8a-44d0-a0cf-4cd2c7a8d5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:12.038269 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c2445-ec8a-44d0-a0cf-4cd2c7a8d5b4 None admin] PATH_INFO: `/v3/services/image` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:12.039095 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c2445-ec8a-44d0-a0cf-4cd2c7a8d5b4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:12.041739 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c2445-ec8a-44d0-a0cf-4cd2c7a8d5b4 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:12.061326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 324/650] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-0f4c2445-ec8a-44d0-a0cf-4cd2c7a8d5b4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:12.061533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:12.062646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:12.063653 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 327/651] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Aug 23 16:26:11 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:12.068456 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c2445-ec8a-44d0-a0cf-4cd2c7a8d5b4 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:12.068670 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ac23e-abe8-40bb-8f3c-746b2f03db7a None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:12.098944 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:12.139026 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:12.207379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ac23e-abe8-40bb-8f3c-746b2f03db7a None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:12.220898 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c2445-ec8a-44d0-a0cf-4cd2c7a8d5b4 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:12.251908 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb6447-1b9b-41a1-b985-09bcecd9d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:12.252993 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb6447-1b9b-41a1-b985-09bcecd9d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:12.253477 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb6447-1b9b-41a1-b985-09bcecd9d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:12.253968 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb6447-1b9b-41a1-b985-09bcecd9d8a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:12.266733 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397e694-f82e-49e2-9d75-ddd76e0a2c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:12.266985 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb6447-1b9b-41a1-b985-09bcecd9d8a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:12.267473 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397e694-f82e-49e2-9d75-ddd76e0a2c1f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:12.267754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397e694-f82e-49e2-9d75-ddd76e0a2c1f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:12.268029 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397e694-f82e-49e2-9d75-ddd76e0a2c1f None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:12.268681 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397e694-f82e-49e2-9d75-ddd76e0a2c1f None admin] RBAC: Adding query filter params (name=image) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:12.269085 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397e694-f82e-49e2-9d75-ddd76e0a2c1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:12.269890 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb6447-1b9b-41a1-b985-09bcecd9d8a0 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:12.270511 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397e694-f82e-49e2-9d75-ddd76e0a2c1f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:12.281185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 328/652] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:12.282350 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397e694-f82e-49e2-9d75-ddd76e0a2c1f None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-b2bb6447-1b9b-41a1-b985-09bcecd9d8a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:12.288292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:12.289244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:12.290168 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:12.290168 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:12.290168 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:12.296754 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 325/653] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:12.298033 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb6447-1b9b-41a1-b985-09bcecd9d8a0 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:12.375647 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:12.406886 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397e694-f82e-49e2-9d75-ddd76e0a2c1f None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:12.433657 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:12.437262 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb6447-1b9b-41a1-b985-09bcecd9d8a0 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:12.446136 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e37629-c2b6-436c-8a42-3bb33ee2829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:12.446774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e37629-c2b6-436c-8a42-3bb33ee2829f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:12.447056 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e37629-c2b6-436c-8a42-3bb33ee2829f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:12.447366 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e37629-c2b6-436c-8a42-3bb33ee2829f None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:12.449036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e37629-c2b6-436c-8a42-3bb33ee2829f None admin] RBAC: Adding query filter params (type=image) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:12.449345 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e37629-c2b6-436c-8a42-3bb33ee2829f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:12.451338 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e37629-c2b6-436c-8a42-3bb33ee2829f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:12.464114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 329/654] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:12.464928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b3f30-9641-48ac-9af8-ab56d9d222b6 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:12.465214 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b3f30-9641-48ac-9af8-ab56d9d222b6 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:12.465487 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b3f30-9641-48ac-9af8-ab56d9d222b6 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:12.466885 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 330/655] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:12.469603 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80513cf6-0039-406f-a4d6-fb25fee632b0 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:12.469888 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80513cf6-0039-406f-a4d6-fb25fee632b0 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:12.470151 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80513cf6-0039-406f-a4d6-fb25fee632b0 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:12.471583 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 331/656] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:12.478638 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d3214-5889-4ca5-aa8d-fa9a77c36004 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:12.478947 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d3214-5889-4ca5-aa8d-fa9a77c36004 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:12.479212 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d3214-5889-4ca5-aa8d-fa9a77c36004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:12.492128 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c91d3-47e6-4d38-9a25-20c09e103bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:12.492777 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c91d3-47e6-4d38-9a25-20c09e103bfb None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:12.493549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c91d3-47e6-4d38-9a25-20c09e103bfb None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:12.493549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c91d3-47e6-4d38-9a25-20c09e103bfb None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:12.494058 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c91d3-47e6-4d38-9a25-20c09e103bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:12.494363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c91d3-47e6-4d38-9a25-20c09e103bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:12.496394 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c91d3-47e6-4d38-9a25-20c09e103bfb None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:12.499767 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-6d3d3214-5889-4ca5-aa8d-fa9a77c36004 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:12.501104 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-6d3d3214-5889-4ca5-aa8d-fa9a77c36004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:12.511028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 326/657] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:12.516799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51222861-0f3e-4e40-9ee8-b918752daa79 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:12.517175 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51222861-0f3e-4e40-9ee8-b918752daa79 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:12.517343 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51222861-0f3e-4e40-9ee8-b918752daa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:12.538151 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-51222861-0f3e-4e40-9ee8-b918752daa79 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:12.539597 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-51222861-0f3e-4e40-9ee8-b918752daa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:12.596470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 332/658] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:26:12.597894 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d3214-5889-4ca5-aa8d-fa9a77c36004 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:12.645371 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 327/659] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:26:12.683016 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:12.718352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d3214-5889-4ca5-aa8d-fa9a77c36004 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:12.757415 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54b31e-6978-4cab-9705-0c85ab6de076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:12.758053 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54b31e-6978-4cab-9705-0c85ab6de076 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:12.758389 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54b31e-6978-4cab-9705-0c85ab6de076 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:12.758667 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54b31e-6978-4cab-9705-0c85ab6de076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:12.766024 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54b31e-6978-4cab-9705-0c85ab6de076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:12.767608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54b31e-6978-4cab-9705-0c85ab6de076 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-8f54b31e-6978-4cab-9705-0c85ab6de076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:26:12.780474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:12.781381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:12.782249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:26:12.782249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:26:12.782249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:26:12.782249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:26:12.782249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:26:12.782249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:26:12.782249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:12.782249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:12.782249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 333/660] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:12.788464 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51222861-0f3e-4e40-9ee8-b918752daa79 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:12.892847 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:12.907718 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51222861-0f3e-4e40-9ee8-b918752daa79 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:12.944882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a590c8a-1b00-460e-84cb-43f494df133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:12.945790 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a590c8a-1b00-460e-84cb-43f494df133d None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:12.946243 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a590c8a-1b00-460e-84cb-43f494df133d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:12.946718 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a590c8a-1b00-460e-84cb-43f494df133d None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:12.947805 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a590c8a-1b00-460e-84cb-43f494df133d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:12.948291 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a590c8a-1b00-460e-84cb-43f494df133d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:12.948559 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54b31e-6978-4cab-9705-0c85ab6de076 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:12.950228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a590c8a-1b00-460e-84cb-43f494df133d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:12.970032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 328/661] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:12.977404 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a590c8a-1b00-460e-84cb-43f494df133d None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:13.063082 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54b31e-6978-4cab-9705-0c85ab6de076 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:13.087124 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a590c8a-1b00-460e-84cb-43f494df133d None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:13.096400 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:13.105808 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02219c3-bff2-4d05-a42f-3860c32771d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:13.106441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02219c3-bff2-4d05-a42f-3860c32771d4 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:13.106835 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02219c3-bff2-4d05-a42f-3860c32771d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:13.107047 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02219c3-bff2-4d05-a42f-3860c32771d4 None admin] PATH_INFO: `/v3/services/network` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:13.107655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02219c3-bff2-4d05-a42f-3860c32771d4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:13.109152 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02219c3-bff2-4d05-a42f-3860c32771d4 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-a02219c3-bff2-4d05-a42f-3860c32771d4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:13.118369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:13.119806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:26:13.120695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:13.124449 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 334/662] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:12 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:13.124578 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29c8ff-45b8-4cb1-8501-cf1fe57d4488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:13.125150 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29c8ff-45b8-4cb1-8501-cf1fe57d4488 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:13.125306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02219c3-bff2-4d05-a42f-3860c32771d4 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:13.125415 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29c8ff-45b8-4cb1-8501-cf1fe57d4488 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:13.125689 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29c8ff-45b8-4cb1-8501-cf1fe57d4488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:13.126417 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29c8ff-45b8-4cb1-8501-cf1fe57d4488 None admin] RBAC: Adding query filter params (role.id=091802a86e334e129210219b7c69359d, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=db2c2345bf6e487bb3451fd6ce17f67f) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:13.126725 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29c8ff-45b8-4cb1-8501-cf1fe57d4488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:13.128199 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29c8ff-45b8-4cb1-8501-cf1fe57d4488 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:13.143684 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 329/663] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:26:12 2022] GET /identity/v3/role_assignments?user.id=db2c2345bf6e487bb3451fd6ce17f67f&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=091802a86e334e129210219b7c69359d => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:13.143684 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29c8ff-45b8-4cb1-8501-cf1fe57d4488 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:13.162623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:13.274544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29c8ff-45b8-4cb1-8501-cf1fe57d4488 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:13.279949 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02219c3-bff2-4d05-a42f-3860c32771d4 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:13.315777 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602463d-cdcb-47f8-b0a7-ae73a572559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:13.316524 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602463d-cdcb-47f8-b0a7-ae73a572559e None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:13.316874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602463d-cdcb-47f8-b0a7-ae73a572559e None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:13.317216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602463d-cdcb-47f8-b0a7-ae73a572559e None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:13.318043 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602463d-cdcb-47f8-b0a7-ae73a572559e None admin] RBAC: Adding query filter params (name=network) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:13.318485 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602463d-cdcb-47f8-b0a7-ae73a572559e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:13.319579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14343ca-6d34-4987-9f90-54777f56f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:13.320229 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14343ca-6d34-4987-9f90-54777f56f027 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:13.320329 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602463d-cdcb-47f8-b0a7-ae73a572559e None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:13.320504 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14343ca-6d34-4987-9f90-54777f56f027 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:13.320776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14343ca-6d34-4987-9f90-54777f56f027 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:13.321367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14343ca-6d34-4987-9f90-54777f56f027 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:13.323476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14343ca-6d34-4987-9f90-54777f56f027 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:13.327311 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 330/664] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Aug 23 16:26:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:13.333561 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602463d-cdcb-47f8-b0a7-ae73a572559e None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-a14343ca-6d34-4987-9f90-54777f56f027 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:13.338013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:13.339097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:13.339965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 335/665] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Aug 23 16:26:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:13.345698 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14343ca-6d34-4987-9f90-54777f56f027 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:13.429640 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:13.455837 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:13.464617 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602463d-cdcb-47f8-b0a7-ae73a572559e None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:13.505166 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122b4be-aee3-43a4-8468-5992bf652669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:13.505771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122b4be-aee3-43a4-8468-5992bf652669 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:13.506051 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122b4be-aee3-43a4-8468-5992bf652669 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:13.506325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122b4be-aee3-43a4-8468-5992bf652669 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:13.506963 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122b4be-aee3-43a4-8468-5992bf652669 None admin] RBAC: Adding query filter params (type=network) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:13.507258 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14343ca-6d34-4987-9f90-54777f56f027 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:13.507417 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122b4be-aee3-43a4-8468-5992bf652669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:13.508649 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122b4be-aee3-43a4-8468-5992bf652669 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:13.523277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 331/666] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Aug 23 16:26:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:13.554190 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74ac10-4d42-4376-b627-7a01bb9e7754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:13.554812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74ac10-4d42-4376-b627-7a01bb9e7754 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:13.555089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74ac10-4d42-4376-b627-7a01bb9e7754 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:13.555433 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74ac10-4d42-4376-b627-7a01bb9e7754 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:13.556081 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74ac10-4d42-4376-b627-7a01bb9e7754 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:13.556383 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74ac10-4d42-4376-b627-7a01bb9e7754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:13.558344 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74ac10-4d42-4376-b627-7a01bb9e7754 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:13.568356 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 336/667] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Aug 23 16:26:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:13.570223 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122b4be-aee3-43a4-8468-5992bf652669 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:13.688014 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122b4be-aee3-43a4-8468-5992bf652669 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:13.725701 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ba5b8-3d30-471d-a079-7654a9283342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:13.726415 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba5b8-3d30-471d-a079-7654a9283342 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:13.726700 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba5b8-3d30-471d-a079-7654a9283342 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:13.726975 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba5b8-3d30-471d-a079-7654a9283342 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:13.727701 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ba5b8-3d30-471d-a079-7654a9283342 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:13.728013 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ba5b8-3d30-471d-a079-7654a9283342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:13.730218 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ba5b8-3d30-471d-a079-7654a9283342 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:13.739436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 332/668] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Aug 23 16:26:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:15.063522 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616b7a3-b0c3-46c1-8489-3baf13914102 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:15.064311 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616b7a3-b0c3-46c1-8489-3baf13914102 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:15.064311 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616b7a3-b0c3-46c1-8489-3baf13914102 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:15.065707 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 337/669] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:15.071377 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01661cc0-0113-4195-97cc-117c0f361f6a None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:15.072042 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01661cc0-0113-4195-97cc-117c0f361f6a None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:15.072042 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01661cc0-0113-4195-97cc-117c0f361f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:15.085220 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:15.091317 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-01661cc0-0113-4195-97cc-117c0f361f6a None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:15.092523 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-01661cc0-0113-4195-97cc-117c0f361f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:15.162943 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 333/670] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:26:15.495788 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616b7a3-b0c3-46c1-8489-3baf13914102 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:15.518655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529dbf0-ea1d-4dc9-86cc-79415eb8254a None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:15.518931 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529dbf0-ea1d-4dc9-86cc-79415eb8254a None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:15.519285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529dbf0-ea1d-4dc9-86cc-79415eb8254a None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:15.521121 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 334/671] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:15.527025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec67d47-5da7-402e-95bc-1679b84c3169 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:15.527449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec67d47-5da7-402e-95bc-1679b84c3169 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:15.527608 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec67d47-5da7-402e-95bc-1679b84c3169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:15.547083 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-6ec67d47-5da7-402e-95bc-1679b84c3169 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:15.548313 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-6ec67d47-5da7-402e-95bc-1679b84c3169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:15.626756 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616b7a3-b0c3-46c1-8489-3baf13914102 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:15.635344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 335/672] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:26:15.663666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:15.678962 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0de4d4-ee05-444d-8bcd-88c62d8ba372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:15.679601 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0de4d4-ee05-444d-8bcd-88c62d8ba372 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:15.679876 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0de4d4-ee05-444d-8bcd-88c62d8ba372 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:15.680135 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0de4d4-ee05-444d-8bcd-88c62d8ba372 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:15.680896 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0de4d4-ee05-444d-8bcd-88c62d8ba372 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:15.682867 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0de4d4-ee05-444d-8bcd-88c62d8ba372 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:15.790160 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 338/673] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Aug 23 16:26:15 2022] POST /identity/v3/services => generated 242 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:26:15.994773 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec67d47-5da7-402e-95bc-1679b84c3169 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:16.012247 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003fb7c-b05c-459b-b9c3-1869e2f6c570 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:16.012589 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003fb7c-b05c-459b-b9c3-1869e2f6c570 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:16.012804 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003fb7c-b05c-459b-b9c3-1869e2f6c570 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:16.014597 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 339/674] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:16.020795 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139aa1e-3b51-4aa3-89b6-e0c4a4470d10 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:16.021514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139aa1e-3b51-4aa3-89b6-e0c4a4470d10 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:16.022004 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139aa1e-3b51-4aa3-89b6-e0c4a4470d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:16.044410 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-6139aa1e-3b51-4aa3-89b6-e0c4a4470d10 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:16.045679 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-6139aa1e-3b51-4aa3-89b6-e0c4a4470d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:16.084860 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:16.127993 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec67d47-5da7-402e-95bc-1679b84c3169 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:16.167264 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 340/675] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:16 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:26:16.179266 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595dba5-7fa3-4b54-906e-592c592cca10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:16.180199 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595dba5-7fa3-4b54-906e-592c592cca10 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:16.180628 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595dba5-7fa3-4b54-906e-592c592cca10 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:16.181077 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595dba5-7fa3-4b54-906e-592c592cca10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:16.194641 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595dba5-7fa3-4b54-906e-592c592cca10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-2595dba5-7fa3-4b54-906e-592c592cca10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:26:16.200112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:16.201350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:16.202288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:16.202288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:16.202288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:16.202288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:16.202288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:26:16.202288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:26:16.202288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:26:16.202288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:26:16.202288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:26:16.202288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:26:16.202288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:26:16.202288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:16.204708 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 336/676] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:26:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:16.215185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139aa1e-3b51-4aa3-89b6-e0c4a4470d10 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:16.335207 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139aa1e-3b51-4aa3-89b6-e0c4a4470d10 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:16.343615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:16.371548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfff97-bf2e-4656-bc6a-f8f28a1add36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:16.372162 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfff97-bf2e-4656-bc6a-f8f28a1add36 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:16.372440 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfff97-bf2e-4656-bc6a-f8f28a1add36 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:16.372711 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfff97-bf2e-4656-bc6a-f8f28a1add36 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:16.373439 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfff97-bf2e-4656-bc6a-f8f28a1add36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:16.373746 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfff97-bf2e-4656-bc6a-f8f28a1add36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:16.375127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfff97-bf2e-4656-bc6a-f8f28a1add36 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:16.385357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 341/677] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:26:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:16.390658 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595dba5-7fa3-4b54-906e-592c592cca10 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:16.415907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871894e-c989-4e80-b9b8-4e7eb50bbefa None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:16.416828 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871894e-c989-4e80-b9b8-4e7eb50bbefa None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:16.417295 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871894e-c989-4e80-b9b8-4e7eb50bbefa None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:16.419129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 342/678] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:26:16.426065 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeb463-f614-4084-8e55-942a9616c3a0 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:16.426348 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeb463-f614-4084-8e55-942a9616c3a0 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:16.426627 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeb463-f614-4084-8e55-942a9616c3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:16.449552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-bffeb463-f614-4084-8e55-942a9616c3a0 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:16.450979 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-bffeb463-f614-4084-8e55-942a9616c3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:16.520319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595dba5-7fa3-4b54-906e-592c592cca10 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:16.551278 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 343/679] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:16 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:26:16.551278 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeb463-f614-4084-8e55-942a9616c3a0 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:16.555361 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:16.576737 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26572b3c-a08e-41d2-92f8-b963a1e429a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:16.578835 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572b3c-a08e-41d2-92f8-b963a1e429a2 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:16.579725 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572b3c-a08e-41d2-92f8-b963a1e429a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:16.580289 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572b3c-a08e-41d2-92f8-b963a1e429a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:16.602128 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26572b3c-a08e-41d2-92f8-b963a1e429a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:16.603774 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26572b3c-a08e-41d2-92f8-b963a1e429a2 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-26572b3c-a08e-41d2-92f8-b963a1e429a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:16.624448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:16.625495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:16.626388 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:16.626388 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:16.626388 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:16.626977 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 337/680] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:16.632758 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26572b3c-a08e-41d2-92f8-b963a1e429a2 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:16.661820 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:16.666701 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeb463-f614-4084-8e55-942a9616c3a0 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:16.703898 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749988d-0404-41f3-a7f5-ef26d89be64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:16.704765 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749988d-0404-41f3-a7f5-ef26d89be64a None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:16.705255 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749988d-0404-41f3-a7f5-ef26d89be64a None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:16.705727 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749988d-0404-41f3-a7f5-ef26d89be64a None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:16.706632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749988d-0404-41f3-a7f5-ef26d89be64a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:16.708243 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749988d-0404-41f3-a7f5-ef26d89be64a None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:16.761278 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26572b3c-a08e-41d2-92f8-b963a1e429a2 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:16.799819 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 344/681] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Aug 23 16:26:16 2022] POST /identity/v3/services => generated 251 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:26:16.816982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930fd27-d9cd-4b25-9092-89d1e16feaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:16.818044 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930fd27-d9cd-4b25-9092-89d1e16feaae None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:16.818515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930fd27-d9cd-4b25-9092-89d1e16feaae None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:16.819023 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930fd27-d9cd-4b25-9092-89d1e16feaae None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:16.820022 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930fd27-d9cd-4b25-9092-89d1e16feaae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:16.820527 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930fd27-d9cd-4b25-9092-89d1e16feaae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:16.822364 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930fd27-d9cd-4b25-9092-89d1e16feaae None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:16.839446 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 338/682] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:16.851308 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749988d-0404-41f3-a7f5-ef26d89be64a None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:16.894895 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930fd27-d9cd-4b25-9092-89d1e16feaae None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:16.952574 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:16.985665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749988d-0404-41f3-a7f5-ef26d89be64a None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:17.031399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0842f-0bf3-475f-89b0-bc4f41b034b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:17.032389 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0842f-0bf3-475f-89b0-bc4f41b034b1 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:17.033133 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0842f-0bf3-475f-89b0-bc4f41b034b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:17.033933 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0842f-0bf3-475f-89b0-bc4f41b034b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:17.045889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0842f-0bf3-475f-89b0-bc4f41b034b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:17.047779 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0842f-0bf3-475f-89b0-bc4f41b034b1 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-67f0842f-0bf3-475f-89b0-bc4f41b034b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:26:17.070185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:17.072390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:17.075514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:17.075514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:17.075514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:26:17.075514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:26:17.075514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:26:17.075514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:26:17.075514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:26:17.075514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:26:17.075514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:26:17.075514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:17.075514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 345/683] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Aug 23 16:26:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:17.082890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0842f-0bf3-475f-89b0-bc4f41b034b1 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:17.088455 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930fd27-d9cd-4b25-9092-89d1e16feaae None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:17.113632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:17.142739 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc74384-f528-4516-b679-c243e2c70cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:17.142957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc74384-f528-4516-b679-c243e2c70cdf None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:17.143211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc74384-f528-4516-b679-c243e2c70cdf None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:17.143625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc74384-f528-4516-b679-c243e2c70cdf None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:17.144238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc74384-f528-4516-b679-c243e2c70cdf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:17.145839 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc74384-f528-4516-b679-c243e2c70cdf None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:17.227537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 339/684] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Aug 23 16:26:16 2022] POST /identity/v3/services => generated 240 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:26:17.258759 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0842f-0bf3-475f-89b0-bc4f41b034b1 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:17.310629 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f47f92-8f18-4cb9-86e3-03cba9ae3799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:17.311277 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47f92-8f18-4cb9-86e3-03cba9ae3799 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:17.311550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47f92-8f18-4cb9-86e3-03cba9ae3799 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:17.311823 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47f92-8f18-4cb9-86e3-03cba9ae3799 None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:17.312685 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f47f92-8f18-4cb9-86e3-03cba9ae3799 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:17.313009 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f47f92-8f18-4cb9-86e3-03cba9ae3799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:17.314465 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f47f92-8f18-4cb9-86e3-03cba9ae3799 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:17.344051 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 346/685] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Aug 23 16:26:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:17.353589 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc74384-f528-4516-b679-c243e2c70cdf None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:17.505683 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:17.514568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc74384-f528-4516-b679-c243e2c70cdf None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:17.561952 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f74a3-fe33-400d-8d08-f04a237f62cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:17.562666 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f74a3-fe33-400d-8d08-f04a237f62cb None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:17.562956 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f74a3-fe33-400d-8d08-f04a237f62cb None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:17.563254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f74a3-fe33-400d-8d08-f04a237f62cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:17.575979 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f74a3-fe33-400d-8d08-f04a237f62cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:17.577688 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f74a3-fe33-400d-8d08-f04a237f62cb None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-fb9f74a3-fe33-400d-8d08-f04a237f62cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:17.597422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:17.598436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:17.599777 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:17.599777 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:17.599777 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:17.599777 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 340/686] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:17.608328 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f47f92-8f18-4cb9-86e3-03cba9ae3799 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:17.706783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:17.747398 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f47f92-8f18-4cb9-86e3-03cba9ae3799 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:17.799945 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e56abc-76af-498a-b7c4-b82b8da7f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:17.800968 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e56abc-76af-498a-b7c4-b82b8da7f20c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:17.801433 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e56abc-76af-498a-b7c4-b82b8da7f20c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:17.801891 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e56abc-76af-498a-b7c4-b82b8da7f20c None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:17.802725 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e56abc-76af-498a-b7c4-b82b8da7f20c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:17.803215 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e56abc-76af-498a-b7c4-b82b8da7f20c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:17.805005 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e56abc-76af-498a-b7c4-b82b8da7f20c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:17.819176 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 347/687] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:17.826262 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f74a3-fe33-400d-8d08-f04a237f62cb None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:17.940359 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f74a3-fe33-400d-8d08-f04a237f62cb None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:17.978205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d32e-3905-43f5-801c-db9c371def5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:17.978883 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d32e-3905-43f5-801c-db9c371def5e None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:17.979164 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d32e-3905-43f5-801c-db9c371def5e None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:17.979465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d32e-3905-43f5-801c-db9c371def5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:17.987183 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74d32e-3905-43f5-801c-db9c371def5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:17.988670 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74d32e-3905-43f5-801c-db9c371def5e None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-9e74d32e-3905-43f5-801c-db9c371def5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:26:18.000507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:18.001483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:18.002394 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:26:18.002394 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:26:18.002394 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:26:18.002394 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:26:18.002394 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:26:18.002394 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:26:18.002394 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:18.002394 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:18.002394 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 341/688] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:18.009349 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e56abc-76af-498a-b7c4-b82b8da7f20c None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:18.136681 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e56abc-76af-498a-b7c4-b82b8da7f20c None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:18.173658 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292143c4-afde-438d-9e84-0e31fd2a6b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:18.174358 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292143c4-afde-438d-9e84-0e31fd2a6b29 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:18.175025 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:18.175659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292143c4-afde-438d-9e84-0e31fd2a6b29 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:18.176140 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292143c4-afde-438d-9e84-0e31fd2a6b29 None admin] PATH_INFO: `/v3/projects` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:18.177014 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292143c4-afde-438d-9e84-0e31fd2a6b29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:18.177492 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292143c4-afde-438d-9e84-0e31fd2a6b29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:18.179118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292143c4-afde-438d-9e84-0e31fd2a6b29 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:18.194473 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 348/689] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:26:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:18.203259 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e092c-e22c-4a06-be1f-0705a6b1033c None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:18.203259 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e092c-e22c-4a06-be1f-0705a6b1033c None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:18.203259 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e092c-e22c-4a06-be1f-0705a6b1033c None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:18.203932 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292143c4-afde-438d-9e84-0e31fd2a6b29 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:18.204013 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 342/690] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:18.208567 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20508d2-dfed-4b84-890d-c13568f11c9f None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:18.208842 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20508d2-dfed-4b84-890d-c13568f11c9f None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:18.209116 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20508d2-dfed-4b84-890d-c13568f11c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:18.232448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:18.235853 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-e20508d2-dfed-4b84-890d-c13568f11c9f None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:18.237737 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-e20508d2-dfed-4b84-890d-c13568f11c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:18.317959 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292143c4-afde-438d-9e84-0e31fd2a6b29 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:18.335396 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 343/691] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:18.361986 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67e8e9-cf0a-4e67-9210-dc02c77e271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:18.362741 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67e8e9-cf0a-4e67-9210-dc02c77e271d None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:18.363080 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67e8e9-cf0a-4e67-9210-dc02c77e271d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:18.363499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67e8e9-cf0a-4e67-9210-dc02c77e271d None admin] PATH_INFO: `/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/db2c2345bf6e487bb3451fd6ce17f67f/roles/091802a86e334e129210219b7c69359d` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:18.365554 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67e8e9-cf0a-4e67-9210-dc02c77e271d None admin] RBAC: Authorizing `identity:create_grant(project_id=947f199ed73148beb3a4ecbc82cded19, user_id=db2c2345bf6e487bb3451fd6ce17f67f, role_id=091802a86e334e129210219b7c69359d)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:18.367110 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67e8e9-cf0a-4e67-9210-dc02c77e271d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:18.502784 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 349/692] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:26:18 2022] PUT /identity/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/db2c2345bf6e487bb3451fd6ce17f67f/roles/091802a86e334e129210219b7c69359d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:26:18.672209 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20508d2-dfed-4b84-890d-c13568f11c9f None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:18.783757 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20508d2-dfed-4b84-890d-c13568f11c9f None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:18.821136 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a67b1-6784-4e67-80f3-e2e4bc4a9cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:18.821778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a67b1-6784-4e67-80f3-e2e4bc4a9cc2 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:18.822056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a67b1-6784-4e67-80f3-e2e4bc4a9cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:18.822364 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a67b1-6784-4e67-80f3-e2e4bc4a9cc2 None admin] PATH_INFO: `/v3/services/image` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:18.823065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a67b1-6784-4e67-80f3-e2e4bc4a9cc2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:18.824487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a67b1-6784-4e67-80f3-e2e4bc4a9cc2 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:18.828562 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-351a67b1-6784-4e67-80f3-e2e4bc4a9cc2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:18.836250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:18.838369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:18.880387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 344/693] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Aug 23 16:26:18 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:18.882239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67e8e9-cf0a-4e67-9210-dc02c77e271d None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:18.903021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:18.954229 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67e8e9-cf0a-4e67-9210-dc02c77e271d None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:18.995779 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00899c-23c3-4010-994f-10bd426a77b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:18.996578 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00899c-23c3-4010-994f-10bd426a77b2 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:18.997073 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00899c-23c3-4010-994f-10bd426a77b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:18.997545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00899c-23c3-4010-994f-10bd426a77b2 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:18.998680 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00899c-23c3-4010-994f-10bd426a77b2 None admin] RBAC: Adding query filter params (name=image) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:18.999246 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00899c-23c3-4010-994f-10bd426a77b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:19.000859 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00899c-23c3-4010-994f-10bd426a77b2 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:19.006698 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 350/694] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:19.012112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a67b1-6784-4e67-80f3-e2e4bc4a9cc2 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:19.123405 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a67b1-6784-4e67-80f3-e2e4bc4a9cc2 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:19.160626 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bd20c-0ad1-4d58-8a5f-31874a696f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:19.161245 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd20c-0ad1-4d58-8a5f-31874a696f7d None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:19.161538 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd20c-0ad1-4d58-8a5f-31874a696f7d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:19.161815 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd20c-0ad1-4d58-8a5f-31874a696f7d None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:19.162454 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bd20c-0ad1-4d58-8a5f-31874a696f7d None admin] RBAC: Adding query filter params (type=image) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:19.162824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bd20c-0ad1-4d58-8a5f-31874a696f7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:19.164261 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bd20c-0ad1-4d58-8a5f-31874a696f7d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:19.171018 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 345/695] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:19.176963 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00899c-23c3-4010-994f-10bd426a77b2 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:19.284542 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00899c-23c3-4010-994f-10bd426a77b2 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:19.305363 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:19.319258 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a073a2-9434-4ad5-b883-b7b52b387698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:19.319962 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a073a2-9434-4ad5-b883-b7b52b387698 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:19.320134 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a073a2-9434-4ad5-b883-b7b52b387698 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:19.325858 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a073a2-9434-4ad5-b883-b7b52b387698 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:19.325858 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a073a2-9434-4ad5-b883-b7b52b387698 None admin] RBAC: Adding query filter params (interface=public, service_id=97f66882ed5047788cd1bd379eec0da9, region_id=RegionOne) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:19.325858 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a073a2-9434-4ad5-b883-b7b52b387698 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:19.325858 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a073a2-9434-4ad5-b883-b7b52b387698 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:19.330606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 351/696] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Aug 23 16:26:19 2022] GET /identity/v3/endpoints?service_id=97f66882ed5047788cd1bd379eec0da9&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:19.336060 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bd20c-0ad1-4d58-8a5f-31874a696f7d None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:19.357442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb17ae-ef97-45d6-b4b6-8ec8f6a8b3ac None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:19.357442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb17ae-ef97-45d6-b4b6-8ec8f6a8b3ac None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:19.357442 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb17ae-ef97-45d6-b4b6-8ec8f6a8b3ac None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:19.358200 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 352/697] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:26:19.366357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da140-387c-488e-a003-28bd1f7fe5e3 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:19.366357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da140-387c-488e-a003-28bd1f7fe5e3 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:19.366357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da140-387c-488e-a003-28bd1f7fe5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:19.382088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-fe3da140-387c-488e-a003-28bd1f7fe5e3 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:19.383199 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-fe3da140-387c-488e-a003-28bd1f7fe5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:19.416913 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:19.466177 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 353/698] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:19 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:26:19.467082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bd20c-0ad1-4d58-8a5f-31874a696f7d None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:19.505220 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37248498-9c02-4f81-ae57-09d42100428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:19.506152 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248498-9c02-4f81-ae57-09d42100428c None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:19.506650 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248498-9c02-4f81-ae57-09d42100428c None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:19.507133 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248498-9c02-4f81-ae57-09d42100428c None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:19.507947 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37248498-9c02-4f81-ae57-09d42100428c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:19.509523 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37248498-9c02-4f81-ae57-09d42100428c None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:19.519207 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 346/699] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Aug 23 16:26:19 2022] GET /identity/v3/services => generated 1002 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:26:19.731865 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64c311-4e5e-4e68-9f21-eaa38ca3eda3 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:19.732072 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64c311-4e5e-4e68-9f21-eaa38ca3eda3 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:19.732414 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64c311-4e5e-4e68-9f21-eaa38ca3eda3 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:19.734137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 354/700] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:19.748587 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96264fa4-240d-401f-b677-a27d5ad9110d None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:19.749231 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96264fa4-240d-401f-b677-a27d5ad9110d None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:19.755711 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96264fa4-240d-401f-b677-a27d5ad9110d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:19.773229 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-96264fa4-240d-401f-b677-a27d5ad9110d None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:19.774627 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-96264fa4-240d-401f-b677-a27d5ad9110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:19.816954 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64c311-4e5e-4e68-9f21-eaa38ca3eda3 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:19.860658 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 347/701] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:19 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:19.985673 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64c311-4e5e-4e68-9f21-eaa38ca3eda3 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:20.006498 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:20.038001 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8099c7-4701-4d41-b2ce-2ee4e7a2ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:20.038641 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8099c7-4701-4d41-b2ce-2ee4e7a2ff4e None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:20.038923 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8099c7-4701-4d41-b2ce-2ee4e7a2ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:20.039193 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8099c7-4701-4d41-b2ce-2ee4e7a2ff4e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:20.039798 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8099c7-4701-4d41-b2ce-2ee4e7a2ff4e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:20.041257 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8099c7-4701-4d41-b2ce-2ee4e7a2ff4e None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-0f8099c7-4701-4d41-b2ce-2ee4e7a2ff4e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:20.050406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:20.051445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:20.052735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 355/702] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Aug 23 16:26:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:20.060170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96264fa4-240d-401f-b677-a27d5ad9110d None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:20.124677 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:20.170380 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96264fa4-240d-401f-b677-a27d5ad9110d None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:20.205286 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8099c7-4701-4d41-b2ce-2ee4e7a2ff4e None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:20.207823 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92cd58-b10f-4c64-b8d2-71b36b0d9a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:20.208778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92cd58-b10f-4c64-b8d2-71b36b0d9a22 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:20.209986 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92cd58-b10f-4c64-b8d2-71b36b0d9a22 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:20.210277 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92cd58-b10f-4c64-b8d2-71b36b0d9a22 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:20.210990 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92cd58-b10f-4c64-b8d2-71b36b0d9a22 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:20.211345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92cd58-b10f-4c64-b8d2-71b36b0d9a22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:20.212845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92cd58-b10f-4c64-b8d2-71b36b0d9a22 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:20.219639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 348/703] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Aug 23 16:26:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:20.229116 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92cd58-b10f-4c64-b8d2-71b36b0d9a22 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:20.355589 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92cd58-b10f-4c64-b8d2-71b36b0d9a22 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:20.356570 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8099c7-4701-4d41-b2ce-2ee4e7a2ff4e None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:20.388015 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:20.402266 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ba936-ba1c-4f6e-a5c7-cb8f90369a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:20.403457 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ba936-ba1c-4f6e-a5c7-cb8f90369a9f None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:20.407152 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ba936-ba1c-4f6e-a5c7-cb8f90369a9f None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:20.407152 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ba936-ba1c-4f6e-a5c7-cb8f90369a9f None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:20.407152 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ba936-ba1c-4f6e-a5c7-cb8f90369a9f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:20.407152 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ba936-ba1c-4f6e-a5c7-cb8f90369a9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:20.407152 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ba936-ba1c-4f6e-a5c7-cb8f90369a9f None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:20.408397 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a319f3-7614-4efe-a82e-fd65242dea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:20.409431 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a319f3-7614-4efe-a82e-fd65242dea2b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:20.409789 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a319f3-7614-4efe-a82e-fd65242dea2b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:20.410142 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a319f3-7614-4efe-a82e-fd65242dea2b None admin] PATH_INFO: `/v3/services/network` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:20.411297 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a319f3-7614-4efe-a82e-fd65242dea2b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:20.413148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a319f3-7614-4efe-a82e-fd65242dea2b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:20.414833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 349/704] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Aug 23 16:26:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:20.422416 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ba936-ba1c-4f6e-a5c7-cb8f90369a9f None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-86a319f3-7614-4efe-a82e-fd65242dea2b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:20.429390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:20.437428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:26:20.438404 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:20.439542 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 356/705] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:20 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:20.440689 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a319f3-7614-4efe-a82e-fd65242dea2b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:20.493444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:20.556369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ba936-ba1c-4f6e-a5c7-cb8f90369a9f None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:20.574493 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a319f3-7614-4efe-a82e-fd65242dea2b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:20.596344 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf678b68-6e59-4657-851a-b57a9dfa5569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:20.596974 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf678b68-6e59-4657-851a-b57a9dfa5569 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:20.597255 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf678b68-6e59-4657-851a-b57a9dfa5569 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:20.597527 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf678b68-6e59-4657-851a-b57a9dfa5569 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:20.598439 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf678b68-6e59-4657-851a-b57a9dfa5569 None admin] RBAC: Adding query filter params (interface=public, service_id=04dc339717f94ba5bfe3bd7f1582b489, region_id=RegionOne) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:20.598755 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf678b68-6e59-4657-851a-b57a9dfa5569 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:20.600505 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf678b68-6e59-4657-851a-b57a9dfa5569 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:20.614686 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 350/706] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Aug 23 16:26:20 2022] GET /identity/v3/endpoints?service_id=04dc339717f94ba5bfe3bd7f1582b489&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:20.617781 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf678b68-6e59-4657-851a-b57a9dfa5569 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:20.620348 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8c8d9-f350-4851-a53e-fbe9258ef39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:20.621334 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8c8d9-f350-4851-a53e-fbe9258ef39e None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:20.621833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8c8d9-f350-4851-a53e-fbe9258ef39e None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:20.622315 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8c8d9-f350-4851-a53e-fbe9258ef39e None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:20.623271 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8c8d9-f350-4851-a53e-fbe9258ef39e None admin] RBAC: Adding query filter params (name=network) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:20.623802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8c8d9-f350-4851-a53e-fbe9258ef39e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:20.625432 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8c8d9-f350-4851-a53e-fbe9258ef39e None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:20.631402 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 357/707] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Aug 23 16:26:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:20.637167 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8c8d9-f350-4851-a53e-fbe9258ef39e None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:20.690125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:20.758070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8c8d9-f350-4851-a53e-fbe9258ef39e None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:20.758421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf678b68-6e59-4657-851a-b57a9dfa5569 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:20.760868 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:20.801533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9c766-9f66-429f-b622-91bba19318d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:20.802236 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9c766-9f66-429f-b622-91bba19318d1 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:20.802518 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9c766-9f66-429f-b622-91bba19318d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:20.802794 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9c766-9f66-429f-b622-91bba19318d1 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:20.803558 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9c766-9f66-429f-b622-91bba19318d1 None admin] RBAC: Adding query filter params (type=network) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:20.803871 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9c766-9f66-429f-b622-91bba19318d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:20.805355 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9c766-9f66-429f-b622-91bba19318d1 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:20.806118 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97175497-04ce-4535-bf07-c019c1ec977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:20.807750 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97175497-04ce-4535-bf07-c019c1ec977a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:20.808393 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97175497-04ce-4535-bf07-c019c1ec977a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:20.808873 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97175497-04ce-4535-bf07-c019c1ec977a None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:20.809746 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97175497-04ce-4535-bf07-c019c1ec977a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:20.811449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97175497-04ce-4535-bf07-c019c1ec977a None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:20.816951 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 358/708] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Aug 23 16:26:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:20.818144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9c766-9f66-429f-b622-91bba19318d1 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:20.824115 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 351/709] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Aug 23 16:26:20 2022] GET /identity/v3/services => generated 1002 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:26:20.842106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44b791-5dae-44b6-ba24-afcbc2241148 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:20.842444 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44b791-5dae-44b6-ba24-afcbc2241148 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:20.842653 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44b791-5dae-44b6-ba24-afcbc2241148 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:20.844348 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 352/710] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:26:20.850106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4cc3a-c7e8-4709-9fe8-584d59a9826e None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:20.850438 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4cc3a-c7e8-4709-9fe8-584d59a9826e None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:20.850651 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4cc3a-c7e8-4709-9fe8-584d59a9826e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:20.873549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-d9c4cc3a-c7e8-4709-9fe8-584d59a9826e None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:20.874744 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-d9c4cc3a-c7e8-4709-9fe8-584d59a9826e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:20.959015 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9c766-9f66-429f-b622-91bba19318d1 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:20.963395 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 353/711] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:20 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:26:21.008370 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516a123-a93c-4631-a3be-fbcd11d9cfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:21.008999 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516a123-a93c-4631-a3be-fbcd11d9cfa5 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:21.009393 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516a123-a93c-4631-a3be-fbcd11d9cfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:21.009763 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516a123-a93c-4631-a3be-fbcd11d9cfa5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:21.010488 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516a123-a93c-4631-a3be-fbcd11d9cfa5 None admin] RBAC: Adding query filter params (interface=public, service_id=bf55f26021284c2baa49b6502666c2cb, region_id=RegionOne) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:21.010799 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516a123-a93c-4631-a3be-fbcd11d9cfa5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:21.012330 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516a123-a93c-4631-a3be-fbcd11d9cfa5 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:21.019040 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 359/712] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Aug 23 16:26:20 2022] GET /identity/v3/endpoints?service_id=bf55f26021284c2baa49b6502666c2cb&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:21.024844 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4cc3a-c7e8-4709-9fe8-584d59a9826e None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:21.080850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:21.140771 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4cc3a-c7e8-4709-9fe8-584d59a9826e None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:21.178343 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a003c-cfdf-4fbf-a04e-4e85bed30443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:21.178954 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a003c-cfdf-4fbf-a04e-4e85bed30443 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:21.179247 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a003c-cfdf-4fbf-a04e-4e85bed30443 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:21.179521 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a003c-cfdf-4fbf-a04e-4e85bed30443 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:21.180136 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a003c-cfdf-4fbf-a04e-4e85bed30443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:21.182037 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a003c-cfdf-4fbf-a04e-4e85bed30443 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:21.189188 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 354/713] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Aug 23 16:26:21 2022] GET /identity/v3/services => generated 1002 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:26:21.303473 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516a123-a93c-4631-a3be-fbcd11d9cfa5 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:21.345724 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:21.427113 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516a123-a93c-4631-a3be-fbcd11d9cfa5 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:21.463409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c25461-a19e-4edb-99d1-f1a0020bb65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:21.464049 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c25461-a19e-4edb-99d1-f1a0020bb65a None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:21.464373 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c25461-a19e-4edb-99d1-f1a0020bb65a None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:21.464654 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c25461-a19e-4edb-99d1-f1a0020bb65a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:21.476043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c25461-a19e-4edb-99d1-f1a0020bb65a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-07c25461-a19e-4edb-99d1-f1a0020bb65a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:26:21.482089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:21.483036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:21.483931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:21.483931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:21.483931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:21.483931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:21.483931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:26:21.483931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:26:21.483931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:26:21.483931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:26:21.483931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:26:21.483931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:26:21.483931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:26:21.483931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:21.483931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 360/714] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:26:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:21.489182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a003c-cfdf-4fbf-a04e-4e85bed30443 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:21.601126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a003c-cfdf-4fbf-a04e-4e85bed30443 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:21.612174 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:21.640067 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d251fe-1d67-4459-b3f1-30dd701bc93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:21.640751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d251fe-1d67-4459-b3f1-30dd701bc93d None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:21.641072 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d251fe-1d67-4459-b3f1-30dd701bc93d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:21.641348 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d251fe-1d67-4459-b3f1-30dd701bc93d None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:21.642020 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d251fe-1d67-4459-b3f1-30dd701bc93d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:21.642325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d251fe-1d67-4459-b3f1-30dd701bc93d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:21.643744 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d251fe-1d67-4459-b3f1-30dd701bc93d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:21.654206 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 355/715] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:26:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:21.659545 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c25461-a19e-4edb-99d1-f1a0020bb65a None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:21.791815 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:21.796685 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c25461-a19e-4edb-99d1-f1a0020bb65a None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:21.834928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212c0c5-254a-4ba3-937d-3351e2641d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:21.835848 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212c0c5-254a-4ba3-937d-3351e2641d64 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:21.836310 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212c0c5-254a-4ba3-937d-3351e2641d64 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:21.836731 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212c0c5-254a-4ba3-937d-3351e2641d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:21.848828 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212c0c5-254a-4ba3-937d-3351e2641d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:21.850582 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212c0c5-254a-4ba3-937d-3351e2641d64 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:21.959566 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ce425-d0f4-4d05-a755-975f4f500266 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:21.959850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ce425-d0f4-4d05-a755-975f4f500266 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:21.960129 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ce425-d0f4-4d05-a755-975f4f500266 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:21.961812 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 356/716] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:26:21.968266 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809faa8-3387-41f3-ac30-f00ed9b4530e None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:21.968539 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809faa8-3387-41f3-ac30-f00ed9b4530e None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:21.968813 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809faa8-3387-41f3-ac30-f00ed9b4530e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:21.988391 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-3809faa8-3387-41f3-ac30-f00ed9b4530e None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:21.989609 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-3809faa8-3387-41f3-ac30-f00ed9b4530e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-7212c0c5-254a-4ba3-937d-3351e2641d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:21.991499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:21.992614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:21.993700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:21.993700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:21.993700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:21.995826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 361/717] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:22.002416 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212c0c5-254a-4ba3-937d-3351e2641d64 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:22.095064 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 357/718] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:26:22.127716 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212c0c5-254a-4ba3-937d-3351e2641d64 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:22.165343 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a32a58-8050-4bc3-9759-a33a9317b997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:22.166191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a32a58-8050-4bc3-9759-a33a9317b997 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:22.166461 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a32a58-8050-4bc3-9759-a33a9317b997 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:22.166728 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a32a58-8050-4bc3-9759-a33a9317b997 None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:22.167399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a32a58-8050-4bc3-9759-a33a9317b997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:22.167734 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a32a58-8050-4bc3-9759-a33a9317b997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:22.169203 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a32a58-8050-4bc3-9759-a33a9317b997 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:22.182453 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 362/719] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:22.187748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809faa8-3387-41f3-ac30-f00ed9b4530e None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:22.430213 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:22.433855 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809faa8-3387-41f3-ac30-f00ed9b4530e None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:22.457689 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a32a58-8050-4bc3-9759-a33a9317b997 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:22.462740 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:22.476101 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9a076-522b-4c65-af67-f0bce2adf351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:22.477217 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9a076-522b-4c65-af67-f0bce2adf351 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:22.477497 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9a076-522b-4c65-af67-f0bce2adf351 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:22.477767 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9a076-522b-4c65-af67-f0bce2adf351 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:22.486540 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9a076-522b-4c65-af67-f0bce2adf351 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:22.488118 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9a076-522b-4c65-af67-f0bce2adf351 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-adb9a076-522b-4c65-af67-f0bce2adf351 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:26:22.501284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:22.502761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:22.503783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:22.503783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:22.503783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:26:22.503783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:26:22.503783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:26:22.503783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:26:22.503783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:26:22.503783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:26:22.503783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:26:22.503783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:22.507487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 358/720] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Aug 23 16:26:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:22.508555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9a076-522b-4c65-af67-f0bce2adf351 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:22.578902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a32a58-8050-4bc3-9759-a33a9317b997 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:22.616187 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823843cb-8561-4fe6-8961-895e88c959b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:22.616952 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823843cb-8561-4fe6-8961-895e88c959b0 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:22.617297 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823843cb-8561-4fe6-8961-895e88c959b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:22.617640 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823843cb-8561-4fe6-8961-895e88c959b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:22.618292 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823843cb-8561-4fe6-8961-895e88c959b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:22.618799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9a076-522b-4c65-af67-f0bce2adf351 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:22.619915 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823843cb-8561-4fe6-8961-895e88c959b0 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-823843cb-8561-4fe6-8961-895e88c959b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:22.629495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:22.630606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:22.631546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 363/721] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Aug 23 16:26:22 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:22.640421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823843cb-8561-4fe6-8961-895e88c959b0 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:22.662208 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03aed7-f5ea-4294-a948-bf91d61c6e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:22.663338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03aed7-f5ea-4294-a948-bf91d61c6e5f None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:22.663845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03aed7-f5ea-4294-a948-bf91d61c6e5f None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:22.664481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03aed7-f5ea-4294-a948-bf91d61c6e5f None admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:22.665560 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03aed7-f5ea-4294-a948-bf91d61c6e5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:22.665969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03aed7-f5ea-4294-a948-bf91d61c6e5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:22.667513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03aed7-f5ea-4294-a948-bf91d61c6e5f None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:22.692210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 359/722] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Aug 23 16:26:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:22.693212 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03aed7-f5ea-4294-a948-bf91d61c6e5f None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:22.716751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:22.722040 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:22.769305 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823843cb-8561-4fe6-8961-895e88c959b0 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:22.805598 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5bfbd-4371-4541-ae5d-5296b8941144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:22.806214 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5bfbd-4371-4541-ae5d-5296b8941144 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:22.807033 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5bfbd-4371-4541-ae5d-5296b8941144 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:22.807509 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5bfbd-4371-4541-ae5d-5296b8941144 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:22.808166 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5bfbd-4371-4541-ae5d-5296b8941144 None admin] RBAC: Adding query filter params (name=image) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:22.808474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5bfbd-4371-4541-ae5d-5296b8941144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:22.809899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5bfbd-4371-4541-ae5d-5296b8941144 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:22.819670 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 364/723] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:22.821107 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5bfbd-4371-4541-ae5d-5296b8941144 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:22.836223 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03aed7-f5ea-4294-a948-bf91d61c6e5f None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:22.876284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d07e9b-a8c1-46c9-973f-5cd28df5c48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:22.876902 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d07e9b-a8c1-46c9-973f-5cd28df5c48c None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:22.877183 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d07e9b-a8c1-46c9-973f-5cd28df5c48c None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:22.877461 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d07e9b-a8c1-46c9-973f-5cd28df5c48c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:22.964410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d07e9b-a8c1-46c9-973f-5cd28df5c48c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:22.966331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d07e9b-a8c1-46c9-973f-5cd28df5c48c None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:22.979826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5bfbd-4371-4541-ae5d-5296b8941144 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:22.985956 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:23.021757 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:23.030689 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ce02c-366b-48d7-aedd-4cb9f8e03e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:23.032093 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ce02c-366b-48d7-aedd-4cb9f8e03e74 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:23.032564 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ce02c-366b-48d7-aedd-4cb9f8e03e74 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:23.033266 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ce02c-366b-48d7-aedd-4cb9f8e03e74 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:23.034212 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ce02c-366b-48d7-aedd-4cb9f8e03e74 None admin] RBAC: Adding query filter params (type=image) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:23.034849 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ce02c-366b-48d7-aedd-4cb9f8e03e74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:23.037573 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ce02c-366b-48d7-aedd-4cb9f8e03e74 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:23.051850 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 365/724] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:23.053067 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ce02c-366b-48d7-aedd-4cb9f8e03e74 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:23.086439 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 360/725] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:26:22 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:26:23.092632 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d07e9b-a8c1-46c9-973f-5cd28df5c48c None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:23.181982 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ce02c-366b-48d7-aedd-4cb9f8e03e74 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:23.223968 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29256642-b7a1-4daf-af04-2330ddea0207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:23.224988 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29256642-b7a1-4daf-af04-2330ddea0207 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:23.225771 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29256642-b7a1-4daf-af04-2330ddea0207 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:23.226406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29256642-b7a1-4daf-af04-2330ddea0207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:23.227365 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29256642-b7a1-4daf-af04-2330ddea0207 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:23.229081 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29256642-b7a1-4daf-af04-2330ddea0207 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:23.232689 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d07e9b-a8c1-46c9-973f-5cd28df5c48c None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:23.256745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:23.276006 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45b5d3-24a0-42d8-b941-76f15e329d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:23.276645 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45b5d3-24a0-42d8-b941-76f15e329d72 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:23.276916 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45b5d3-24a0-42d8-b941-76f15e329d72 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:23.277182 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45b5d3-24a0-42d8-b941-76f15e329d72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:23.287871 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45b5d3-24a0-42d8-b941-76f15e329d72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:23.289324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45b5d3-24a0-42d8-b941-76f15e329d72 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-fa45b5d3-24a0-42d8-b941-76f15e329d72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:23.303236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:23.304440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:23.305369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:23.305369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:23.305369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:23.305762 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 361/726] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:23.307343 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87110894-f32d-4ddc-a88e-2008755bff8a None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:23.307632 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87110894-f32d-4ddc-a88e-2008755bff8a None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:23.307909 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87110894-f32d-4ddc-a88e-2008755bff8a None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:23.309208 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 362/727] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:23.309925 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87110894-f32d-4ddc-a88e-2008755bff8a None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:23.360376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 366/728] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Aug 23 16:26:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:26:23.362192 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625e532-edf8-47d2-99af-c7a1537b58c8 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:23.362656 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625e532-edf8-47d2-99af-c7a1537b58c8 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:23.362930 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625e532-edf8-47d2-99af-c7a1537b58c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:23.404429 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-8625e532-edf8-47d2-99af-c7a1537b58c8 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:23.405784 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-8625e532-edf8-47d2-99af-c7a1537b58c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:23.456772 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87110894-f32d-4ddc-a88e-2008755bff8a None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:23.480857 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:23.503680 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db28d2-ef1d-4955-b2d9-5229ef5a428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:23.504981 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db28d2-ef1d-4955-b2d9-5229ef5a428a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:23.506804 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db28d2-ef1d-4955-b2d9-5229ef5a428a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:23.506804 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db28d2-ef1d-4955-b2d9-5229ef5a428a None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:23.506804 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db28d2-ef1d-4955-b2d9-5229ef5a428a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:23.506804 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db28d2-ef1d-4955-b2d9-5229ef5a428a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:23.508724 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db28d2-ef1d-4955-b2d9-5229ef5a428a None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:23.519499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 367/729] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:23 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:23.528238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 363/730] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:23.533445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625e532-edf8-47d2-99af-c7a1537b58c8 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:23.547986 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c105aa-f086-4842-8513-87db4926d7f1 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:23.548323 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c105aa-f086-4842-8513-87db4926d7f1 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:23.548545 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c105aa-f086-4842-8513-87db4926d7f1 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:23.554861 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 364/731] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:23.556802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfcea4-3b12-4e77-9581-fa805a32ee79 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:23.557086 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfcea4-3b12-4e77-9581-fa805a32ee79 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:23.557359 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfcea4-3b12-4e77-9581-fa805a32ee79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:23.580508 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-45cfcea4-3b12-4e77-9581-fa805a32ee79 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:23.581736 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-45cfcea4-3b12-4e77-9581-fa805a32ee79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:23.610809 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:23.669663 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 365/732] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:23 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:26:23.670377 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625e532-edf8-47d2-99af-c7a1537b58c8 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:23.706049 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75766425-756b-4d95-9992-d53e272f75f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:23.706678 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75766425-756b-4d95-9992-d53e272f75f5 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:23.706953 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75766425-756b-4d95-9992-d53e272f75f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:23.707240 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75766425-756b-4d95-9992-d53e272f75f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:23.714760 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75766425-756b-4d95-9992-d53e272f75f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:23.716221 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75766425-756b-4d95-9992-d53e272f75f5 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-75766425-756b-4d95-9992-d53e272f75f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:26:23.727632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:23.729156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:23.730043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:26:23.730043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:26:23.730043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:26:23.730043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:26:23.730043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:26:23.730043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:26:23.730043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:23.730043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:23.730043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 368/733] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:23.735454 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfcea4-3b12-4e77-9581-fa805a32ee79 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:23.843715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfcea4-3b12-4e77-9581-fa805a32ee79 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:23.873517 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75766425-756b-4d95-9992-d53e272f75f5 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:23.882248 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae2432-4f92-470f-9b08-568f6f6e9f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:23.882731 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae2432-4f92-470f-9b08-568f6f6e9f00 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:23.883008 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae2432-4f92-470f-9b08-568f6f6e9f00 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:23.883324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae2432-4f92-470f-9b08-568f6f6e9f00 None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:23.884027 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae2432-4f92-470f-9b08-568f6f6e9f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:23.884335 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae2432-4f92-470f-9b08-568f6f6e9f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:23.886306 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae2432-4f92-470f-9b08-568f6f6e9f00 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:23.898991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 366/734] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:26:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:23.907567 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae2432-4f92-470f-9b08-568f6f6e9f00 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:23.929966 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:23.934202 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:24.012172 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75766425-756b-4d95-9992-d53e272f75f5 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:24.027701 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae2432-4f92-470f-9b08-568f6f6e9f00 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:24.053500 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33978770-bb7e-4980-913d-000c8513134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:24.054714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33978770-bb7e-4980-913d-000c8513134c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:24.054940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33978770-bb7e-4980-913d-000c8513134c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:24.055214 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33978770-bb7e-4980-913d-000c8513134c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:24.055831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33978770-bb7e-4980-913d-000c8513134c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:24.057368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33978770-bb7e-4980-913d-000c8513134c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-33978770-bb7e-4980-913d-000c8513134c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:24.066684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:24.067735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:26:24.068568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:24.069796 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3601e-94f8-4c9a-92d7-361c7121ca20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:24.069796 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3601e-94f8-4c9a-92d7-361c7121ca20 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:24.069796 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3601e-94f8-4c9a-92d7-361c7121ca20 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:24.069796 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3601e-94f8-4c9a-92d7-361c7121ca20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:24.070061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3601e-94f8-4c9a-92d7-361c7121ca20 None admin] RBAC: Adding query filter params (role.id=091802a86e334e129210219b7c69359d, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=db2c2345bf6e487bb3451fd6ce17f67f) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:24.070061 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3601e-94f8-4c9a-92d7-361c7121ca20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:24.071140 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3601e-94f8-4c9a-92d7-361c7121ca20 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:24.073584 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 369/735] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Aug 23 16:26:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:24.074453 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33978770-bb7e-4980-913d-000c8513134c None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:24.079317 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 367/736] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:26:23 2022] GET /identity/v3/role_assignments?user.id=db2c2345bf6e487bb3451fd6ce17f67f&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=091802a86e334e129210219b7c69359d => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:24.079317 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3601e-94f8-4c9a-92d7-361c7121ca20 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:24.187190 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:24.203244 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33978770-bb7e-4980-913d-000c8513134c None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:24.206145 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:24.210972 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3601e-94f8-4c9a-92d7-361c7121ca20 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:24.243487 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544cf24-de9a-4043-8428-34e4bbe0c7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:24.244902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544cf24-de9a-4043-8428-34e4bbe0c7f7 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:24.245257 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544cf24-de9a-4043-8428-34e4bbe0c7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:24.245602 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544cf24-de9a-4043-8428-34e4bbe0c7f7 None admin] PATH_INFO: `/v3/services/network` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:24.246272 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544cf24-de9a-4043-8428-34e4bbe0c7f7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:24.247835 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544cf24-de9a-4043-8428-34e4bbe0c7f7 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:24.253626 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d02263-01bd-44b6-a9ba-cc234bc16965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:24.254497 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02263-01bd-44b6-a9ba-cc234bc16965 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:24.254967 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02263-01bd-44b6-a9ba-cc234bc16965 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:24.255446 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02263-01bd-44b6-a9ba-cc234bc16965 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:24.256224 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d02263-01bd-44b6-a9ba-cc234bc16965 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:24.256667 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d02263-01bd-44b6-a9ba-cc234bc16965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:24.258213 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d02263-01bd-44b6-a9ba-cc234bc16965 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-1544cf24-de9a-4043-8428-34e4bbe0c7f7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:24.259019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:24.260774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:26:24.261812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:24.263528 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 370/737] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:24 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:24.267726 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 368/738] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Aug 23 16:26:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:24.269156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544cf24-de9a-4043-8428-34e4bbe0c7f7 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:24.274772 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d02263-01bd-44b6-a9ba-cc234bc16965 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:24.416895 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544cf24-de9a-4043-8428-34e4bbe0c7f7 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:24.424810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d02263-01bd-44b6-a9ba-cc234bc16965 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:24.470765 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb91ae1-88e2-4207-b2fa-f0f6bb8a366e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:24.471589 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb91ae1-88e2-4207-b2fa-f0f6bb8a366e None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:24.471875 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb91ae1-88e2-4207-b2fa-f0f6bb8a366e None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:24.472236 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb91ae1-88e2-4207-b2fa-f0f6bb8a366e None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:24.472878 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb91ae1-88e2-4207-b2fa-f0f6bb8a366e None admin] RBAC: Adding query filter params (name=network) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:24.473224 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb91ae1-88e2-4207-b2fa-f0f6bb8a366e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:24.474545 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64883a3b-185e-4cb6-829c-d4bf615c5911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:24.474764 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb91ae1-88e2-4207-b2fa-f0f6bb8a366e None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:24.475617 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64883a3b-185e-4cb6-829c-d4bf615c5911 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:24.476435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64883a3b-185e-4cb6-829c-d4bf615c5911 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:24.477343 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64883a3b-185e-4cb6-829c-d4bf615c5911 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:24.478234 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64883a3b-185e-4cb6-829c-d4bf615c5911 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:24.478997 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64883a3b-185e-4cb6-829c-d4bf615c5911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:24.480662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64883a3b-185e-4cb6-829c-d4bf615c5911 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:24.483322 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 371/739] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Aug 23 16:26:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:24.487670 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb91ae1-88e2-4207-b2fa-f0f6bb8a366e None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:24.491202 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 369/740] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Aug 23 16:26:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:24.503255 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64883a3b-185e-4cb6-829c-d4bf615c5911 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:24.518346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:24.531792 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:24.621815 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb91ae1-88e2-4207-b2fa-f0f6bb8a366e None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:24.643266 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64883a3b-185e-4cb6-829c-d4bf615c5911 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:24.671594 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c2950-602a-428f-bd43-fe6dec043205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:24.673176 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c2950-602a-428f-bd43-fe6dec043205 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:24.673921 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c2950-602a-428f-bd43-fe6dec043205 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:24.674400 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c2950-602a-428f-bd43-fe6dec043205 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:24.675564 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c2950-602a-428f-bd43-fe6dec043205 None admin] RBAC: Adding query filter params (type=network) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:24.676566 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c2950-602a-428f-bd43-fe6dec043205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:24.678784 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c2950-602a-428f-bd43-fe6dec043205 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:24.687140 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 372/741] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Aug 23 16:26:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:24.693622 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a66d0-8c2e-47bb-9eb8-0ee790b8b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:24.693622 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a66d0-8c2e-47bb-9eb8-0ee790b8b887 None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:24.693622 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a66d0-8c2e-47bb-9eb8-0ee790b8b887 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:24.693622 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a66d0-8c2e-47bb-9eb8-0ee790b8b887 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:24.694154 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a66d0-8c2e-47bb-9eb8-0ee790b8b887 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:24.695134 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c2950-602a-428f-bd43-fe6dec043205 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:24.695579 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a66d0-8c2e-47bb-9eb8-0ee790b8b887 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:24.815215 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:24.825501 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c2950-602a-428f-bd43-fe6dec043205 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:24.838065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 370/742] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Aug 23 16:26:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:26:24.889527 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef8115-f976-40cf-89b1-1ec7d94e1f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:24.951927 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8115-f976-40cf-89b1-1ec7d94e1f27 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:24.951927 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8115-f976-40cf-89b1-1ec7d94e1f27 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:24.951927 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8115-f976-40cf-89b1-1ec7d94e1f27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:24.951927 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef8115-f976-40cf-89b1-1ec7d94e1f27 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:24.951927 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef8115-f976-40cf-89b1-1ec7d94e1f27 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:25.102460 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 373/743] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Aug 23 16:26:24 2022] POST /identity/v3/endpoints => generated 337 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:26:25.783975 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602056d-86e6-4e09-8778-930e746fdd21 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:25.784522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602056d-86e6-4e09-8778-930e746fdd21 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:25.784606 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602056d-86e6-4e09-8778-930e746fdd21 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:25.785976 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 371/744] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:25.792236 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dc828-21df-4641-9caf-98a1e3ff8772 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:25.792955 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dc828-21df-4641-9caf-98a1e3ff8772 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:25.792955 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dc828-21df-4641-9caf-98a1e3ff8772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:25.811947 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-890dc828-21df-4641-9caf-98a1e3ff8772 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:25.813159 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-890dc828-21df-4641-9caf-98a1e3ff8772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:25.894096 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 374/745] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:25 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:26.219661 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602056d-86e6-4e09-8778-930e746fdd21 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:26.315514 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:26.375673 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602056d-86e6-4e09-8778-930e746fdd21 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:26.420846 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae595b8-5886-4c3f-8341-d3a42802b376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:26.421467 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae595b8-5886-4c3f-8341-d3a42802b376 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:26.421786 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae595b8-5886-4c3f-8341-d3a42802b376 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:26.422121 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae595b8-5886-4c3f-8341-d3a42802b376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:26.473901 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e531379-3f9f-496d-bffa-505ab352eeef None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:26.474096 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e531379-3f9f-496d-bffa-505ab352eeef None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:26.474359 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e531379-3f9f-496d-bffa-505ab352eeef None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:26.476059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 375/746] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:26:26.482449 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e5f4a-1101-4b84-be39-fbd1c8fa7b3a None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:26.482735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e5f4a-1101-4b84-be39-fbd1c8fa7b3a None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:26.483006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e5f4a-1101-4b84-be39-fbd1c8fa7b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:26.501275 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-cb2e5f4a-1101-4b84-be39-fbd1c8fa7b3a None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:26.502493 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-cb2e5f4a-1101-4b84-be39-fbd1c8fa7b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:26.512592 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae595b8-5886-4c3f-8341-d3a42802b376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:26.515593 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae595b8-5886-4c3f-8341-d3a42802b376 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:26.586927 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 376/747] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:26 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:26:26.606932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:26.660317 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 372/748] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:26:26 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:26:26.666968 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e5f4a-1101-4b84-be39-fbd1c8fa7b3a None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:26.671459 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:26.798054 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e5f4a-1101-4b84-be39-fbd1c8fa7b3a None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:26.833223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494984f1-44a8-43e9-bc33-0fe934ee4524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:26.833851 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494984f1-44a8-43e9-bc33-0fe934ee4524 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:26.834126 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494984f1-44a8-43e9-bc33-0fe934ee4524 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:26.834395 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494984f1-44a8-43e9-bc33-0fe934ee4524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:26.850851 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494984f1-44a8-43e9-bc33-0fe934ee4524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:26.852776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494984f1-44a8-43e9-bc33-0fe934ee4524 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-494984f1-44a8-43e9-bc33-0fe934ee4524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:26:26.869943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:26.876752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:26:26.877981 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:26:26.877981 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:26:26.877981 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:26.877981 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 377/749] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:26.881481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae595b8-5886-4c3f-8341-d3a42802b376 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:26.916278 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494984f1-44a8-43e9-bc33-0fe934ee4524 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:26.995314 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:27.018980 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae595b8-5886-4c3f-8341-d3a42802b376 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:27.045943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494984f1-44a8-43e9-bc33-0fe934ee4524 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:27.061152 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f72d7e-db58-4d0f-98d5-14756cf8ae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:27.062105 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f72d7e-db58-4d0f-98d5-14756cf8ae87 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:27.062583 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f72d7e-db58-4d0f-98d5-14756cf8ae87 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:27.063045 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f72d7e-db58-4d0f-98d5-14756cf8ae87 None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:27.064017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f72d7e-db58-4d0f-98d5-14756cf8ae87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:27.064504 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f72d7e-db58-4d0f-98d5-14756cf8ae87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:27.066220 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f72d7e-db58-4d0f-98d5-14756cf8ae87 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:27.080007 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 373/750] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:27.088535 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd305cb9-a6b2-4288-bd8f-c137f4b8f5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:27.089259 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd305cb9-a6b2-4288-bd8f-c137f4b8f5ea None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:27.089579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd305cb9-a6b2-4288-bd8f-c137f4b8f5ea None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:27.089855 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd305cb9-a6b2-4288-bd8f-c137f4b8f5ea None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:27.090514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd305cb9-a6b2-4288-bd8f-c137f4b8f5ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:27.092051 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd305cb9-a6b2-4288-bd8f-c137f4b8f5ea None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-fd305cb9-a6b2-4288-bd8f-c137f4b8f5ea None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:27.102227 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:27.110446 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:27.112230 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 378/751] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Aug 23 16:26:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:27.116931 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f72d7e-db58-4d0f-98d5-14756cf8ae87 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:27.146118 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:27.245127 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f72d7e-db58-4d0f-98d5-14756cf8ae87 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:27.287944 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc69197-5f14-4a68-b3fe-1a1975a802b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:27.288568 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc69197-5f14-4a68-b3fe-1a1975a802b3 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:27.288845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc69197-5f14-4a68-b3fe-1a1975a802b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:27.289120 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc69197-5f14-4a68-b3fe-1a1975a802b3 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:27.289760 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc69197-5f14-4a68-b3fe-1a1975a802b3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:27.290062 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc69197-5f14-4a68-b3fe-1a1975a802b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:27.291466 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc69197-5f14-4a68-b3fe-1a1975a802b3 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:27.296864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 374/752] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Aug 23 16:26:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:27.302535 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd305cb9-a6b2-4288-bd8f-c137f4b8f5ea None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:27.430552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd305cb9-a6b2-4288-bd8f-c137f4b8f5ea None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:27.455754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:27.473844 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c4717-921e-483d-a6bf-5fd63210c6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:27.474455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c4717-921e-483d-a6bf-5fd63210c6f3 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:27.474838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c4717-921e-483d-a6bf-5fd63210c6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:27.475076 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c4717-921e-483d-a6bf-5fd63210c6f3 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:27.475744 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c4717-921e-483d-a6bf-5fd63210c6f3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:27.476085 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c4717-921e-483d-a6bf-5fd63210c6f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:27.477637 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c4717-921e-483d-a6bf-5fd63210c6f3 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:27.482849 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 379/753] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Aug 23 16:26:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:27.578096 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca06aa-a4d5-40ba-b20a-779b94f8b32f None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:27.578307 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca06aa-a4d5-40ba-b20a-779b94f8b32f None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:27.578566 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca06aa-a4d5-40ba-b20a-779b94f8b32f None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:27.579964 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 375/754] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:27.586071 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3b544-0e8a-4f04-ad58-c432b7531077 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:27.586376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3b544-0e8a-4f04-ad58-c432b7531077 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:27.586615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3b544-0e8a-4f04-ad58-c432b7531077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:27.607348 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-b0b3b544-0e8a-4f04-ad58-c432b7531077 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:27.608636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-b0b3b544-0e8a-4f04-ad58-c432b7531077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:27.692499 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 380/755] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:27 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:28.039159 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca06aa-a4d5-40ba-b20a-779b94f8b32f None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:28.151717 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:28.173822 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca06aa-a4d5-40ba-b20a-779b94f8b32f None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:28.208438 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c7703-04d9-4624-b663-69ced86d1727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:28.209068 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7703-04d9-4624-b663-69ced86d1727 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:28.209346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7703-04d9-4624-b663-69ced86d1727 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:28.209618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7703-04d9-4624-b663-69ced86d1727 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:28.210232 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c7703-04d9-4624-b663-69ced86d1727 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:28.211625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c7703-04d9-4624-b663-69ced86d1727 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-d27c7703-04d9-4624-b663-69ced86d1727 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:28.221056 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:28.222170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:28.223453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 376/756] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:26:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:26:28.228917 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3b544-0e8a-4f04-ad58-c432b7531077 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:28.332214 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3b544-0e8a-4f04-ad58-c432b7531077 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:28.346908 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:28.367659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf016e-5879-4aef-ad9e-ba872bfeb631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:28.368343 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf016e-5879-4aef-ad9e-ba872bfeb631 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:28.368656 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf016e-5879-4aef-ad9e-ba872bfeb631 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:28.368926 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf016e-5879-4aef-ad9e-ba872bfeb631 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:28.369939 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf016e-5879-4aef-ad9e-ba872bfeb631 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:28.370237 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf016e-5879-4aef-ad9e-ba872bfeb631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:28.371639 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf016e-5879-4aef-ad9e-ba872bfeb631 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:28.376328 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 381/757] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:26:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:28.382272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c7703-04d9-4624-b663-69ced86d1727 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:28.499428 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c7703-04d9-4624-b663-69ced86d1727 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:28.536953 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51755249-c701-4fbd-8f53-b63a0def1d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:28.536953 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755249-c701-4fbd-8f53-b63a0def1d65 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:28.536953 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755249-c701-4fbd-8f53-b63a0def1d65 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:28.536953 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755249-c701-4fbd-8f53-b63a0def1d65 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:28.537427 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51755249-c701-4fbd-8f53-b63a0def1d65 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:28.537677 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51755249-c701-4fbd-8f53-b63a0def1d65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:28.539054 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51755249-c701-4fbd-8f53-b63a0def1d65 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:28.543797 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 377/758] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:26:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:29.728749 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab312e6-a113-4ced-a31e-6e33a9fc2737 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:29.729328 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab312e6-a113-4ced-a31e-6e33a9fc2737 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:29.729328 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab312e6-a113-4ced-a31e-6e33a9fc2737 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:29.730738 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 382/759] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:29.736722 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886df1ed-98dd-478a-92d5-351335f877e9 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:29.737456 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886df1ed-98dd-478a-92d5-351335f877e9 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:29.737606 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886df1ed-98dd-478a-92d5-351335f877e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:29.766774 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-886df1ed-98dd-478a-92d5-351335f877e9 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:29.766774 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-886df1ed-98dd-478a-92d5-351335f877e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:29.773977 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:29.831235 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 378/760] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:29 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:30.156241 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab312e6-a113-4ced-a31e-6e33a9fc2737 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:30.258395 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab312e6-a113-4ced-a31e-6e33a9fc2737 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:30.293453 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ac2ef-365f-4bdc-814a-ed132227b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:30.294057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac2ef-365f-4bdc-814a-ed132227b3ce None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:30.294337 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac2ef-365f-4bdc-814a-ed132227b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:30.294611 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac2ef-365f-4bdc-814a-ed132227b3ce None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:30.295284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ac2ef-365f-4bdc-814a-ed132227b3ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:30.296650 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ac2ef-365f-4bdc-814a-ed132227b3ce None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:30.393878 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 383/761] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Aug 23 16:26:30 2022] POST /identity/v3/services => generated 269 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:26:30.779322 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676aab-af7e-4d62-b605-bab854bdd4ff None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:30.779791 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676aab-af7e-4d62-b605-bab854bdd4ff None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:30.779890 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676aab-af7e-4d62-b605-bab854bdd4ff None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:30.781194 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 379/762] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:30.786496 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bb07b-1794-4abc-9283-2574a210df3d None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:30.786951 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bb07b-1794-4abc-9283-2574a210df3d None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:30.787153 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bb07b-1794-4abc-9283-2574a210df3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:30.808351 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-550bb07b-1794-4abc-9283-2574a210df3d None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:30.809540 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-550bb07b-1794-4abc-9283-2574a210df3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:30.839825 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:30.886875 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 384/763] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:30 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:26:31.210742 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68676aab-af7e-4d62-b605-bab854bdd4ff None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:31.312497 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68676aab-af7e-4d62-b605-bab854bdd4ff None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:31.346723 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3361f-2ef8-4de6-9820-289e2dc93d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:31.347350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3361f-2ef8-4de6-9820-289e2dc93d98 None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:31.347637 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3361f-2ef8-4de6-9820-289e2dc93d98 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:31.347905 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3361f-2ef8-4de6-9820-289e2dc93d98 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:31.348534 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3361f-2ef8-4de6-9820-289e2dc93d98 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:31.349891 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3361f-2ef8-4de6-9820-289e2dc93d98 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:31.452799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 380/764] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Aug 23 16:26:31 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:26:32.644386 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01563b-1f5f-4f32-9348-2d7f42997af4 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:32.645021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01563b-1f5f-4f32-9348-2d7f42997af4 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:32.645021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01563b-1f5f-4f32-9348-2d7f42997af4 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:32.646241 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 385/765] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:32.652498 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb58f0c-a52b-4b76-ad6c-1fcb764493fa None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:32.652932 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb58f0c-a52b-4b76-ad6c-1fcb764493fa None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:32.653043 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb58f0c-a52b-4b76-ad6c-1fcb764493fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:32.665661 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:32.671448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-8fb58f0c-a52b-4b76-ad6c-1fcb764493fa None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:32.672671 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-8fb58f0c-a52b-4b76-ad6c-1fcb764493fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:32.750263 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 381/766] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:32 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:33.076100 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01563b-1f5f-4f32-9348-2d7f42997af4 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:33.182530 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01563b-1f5f-4f32-9348-2d7f42997af4 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:33.217173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7eda8d-e795-4e3a-a453-6fccce2e5035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:33.217802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eda8d-e795-4e3a-a453-6fccce2e5035 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:33.218080 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eda8d-e795-4e3a-a453-6fccce2e5035 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:33.218394 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eda8d-e795-4e3a-a453-6fccce2e5035 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:33.218980 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7eda8d-e795-4e3a-a453-6fccce2e5035 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:33.221165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7eda8d-e795-4e3a-a453-6fccce2e5035 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-3d7eda8d-e795-4e3a-a453-6fccce2e5035 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:33.229776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:33.230919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:26:33.232154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:33.235380 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 386/767] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Aug 23 16:26:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:33.236810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb58f0c-a52b-4b76-ad6c-1fcb764493fa None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:33.334482 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb58f0c-a52b-4b76-ad6c-1fcb764493fa None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:33.364420 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:33.369687 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051f29f-7338-4739-bbf5-e2e823ac3556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:33.370292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051f29f-7338-4739-bbf5-e2e823ac3556 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:33.370562 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051f29f-7338-4739-bbf5-e2e823ac3556 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:33.370828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051f29f-7338-4739-bbf5-e2e823ac3556 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:33.371482 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051f29f-7338-4739-bbf5-e2e823ac3556 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:33.371780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051f29f-7338-4739-bbf5-e2e823ac3556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:33.373140 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051f29f-7338-4739-bbf5-e2e823ac3556 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:33.377934 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 382/768] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Aug 23 16:26:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:33.383918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7eda8d-e795-4e3a-a453-6fccce2e5035 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:33.413754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:33.500906 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7eda8d-e795-4e3a-a453-6fccce2e5035 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:33.541546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72689ee-20a0-42f7-bf10-d187af5fb976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:33.542180 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72689ee-20a0-42f7-bf10-d187af5fb976 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:33.542458 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72689ee-20a0-42f7-bf10-d187af5fb976 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:33.542727 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72689ee-20a0-42f7-bf10-d187af5fb976 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:33.543589 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72689ee-20a0-42f7-bf10-d187af5fb976 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:33.545262 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72689ee-20a0-42f7-bf10-d187af5fb976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:33.545262 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72689ee-20a0-42f7-bf10-d187af5fb976 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:33.550871 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 387/769] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Aug 23 16:26:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:33.557105 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051f29f-7338-4739-bbf5-e2e823ac3556 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:33.664286 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051f29f-7338-4739-bbf5-e2e823ac3556 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:33.688111 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558ef74-0dd5-4a3e-b9d0-ffdef8732de2 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:33.688656 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558ef74-0dd5-4a3e-b9d0-ffdef8732de2 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:33.688656 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558ef74-0dd5-4a3e-b9d0-ffdef8732de2 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:33.689963 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 388/770] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:26:33.694878 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00fd46-b4a8-4f33-9788-5dc2c9604e74 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:33.695161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00fd46-b4a8-4f33-9788-5dc2c9604e74 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:33.695466 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00fd46-b4a8-4f33-9788-5dc2c9604e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:33.699206 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a820cd6-4b3e-421d-ac25-6d6fbb2a68e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:33.699911 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820cd6-4b3e-421d-ac25-6d6fbb2a68e0 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:33.700120 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820cd6-4b3e-421d-ac25-6d6fbb2a68e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:33.700397 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820cd6-4b3e-421d-ac25-6d6fbb2a68e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:33.701102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a820cd6-4b3e-421d-ac25-6d6fbb2a68e0 None admin] RBAC: Adding query filter params (interface=public, service_id=fadd8b29b8314c76a28664b7f950c5b9, region_id=RegionOne) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:33.701412 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a820cd6-4b3e-421d-ac25-6d6fbb2a68e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:33.702776 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a820cd6-4b3e-421d-ac25-6d6fbb2a68e0 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:33.708077 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 383/771] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Aug 23 16:26:33 2022] GET /identity/v3/endpoints?service_id=fadd8b29b8314c76a28664b7f950c5b9&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:33.714038 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a820cd6-4b3e-421d-ac25-6d6fbb2a68e0 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:33.714364 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-0b00fd46-b4a8-4f33-9788-5dc2c9604e74 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:33.715573 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-0b00fd46-b4a8-4f33-9788-5dc2c9604e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:33.776059 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:33.798675 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 389/772] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:33 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:26:33.818550 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a820cd6-4b3e-421d-ac25-6d6fbb2a68e0 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:33.856704 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bc41b-a134-4c7d-ac9f-bc00a9c61d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:33.857310 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bc41b-a134-4c7d-ac9f-bc00a9c61d58 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:33.857585 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bc41b-a134-4c7d-ac9f-bc00a9c61d58 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:33.857857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bc41b-a134-4c7d-ac9f-bc00a9c61d58 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:33.858463 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bc41b-a134-4c7d-ac9f-bc00a9c61d58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:33.859855 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bc41b-a134-4c7d-ac9f-bc00a9c61d58 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:33.865763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 384/773] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Aug 23 16:26:33 2022] GET /identity/v3/services => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:26:34.157495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00fd46-b4a8-4f33-9788-5dc2c9604e74 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:34.183823 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:34.267233 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00fd46-b4a8-4f33-9788-5dc2c9604e74 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:34.303121 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1588890-0328-4b83-af6c-8d2beb4515a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:34.303782 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1588890-0328-4b83-af6c-8d2beb4515a4 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:34.304056 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1588890-0328-4b83-af6c-8d2beb4515a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:34.304322 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1588890-0328-4b83-af6c-8d2beb4515a4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:34.304906 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1588890-0328-4b83-af6c-8d2beb4515a4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:34.306832 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1588890-0328-4b83-af6c-8d2beb4515a4 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-b1588890-0328-4b83-af6c-8d2beb4515a4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:34.316122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:34.317326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:34.318548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 390/774] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:26:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:34.324034 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bc41b-a134-4c7d-ac9f-bc00a9c61d58 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:34.440860 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bc41b-a134-4c7d-ac9f-bc00a9c61d58 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:34.468103 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:34.479492 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef329e72-169a-4756-837e-becbbabdffc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:34.480100 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef329e72-169a-4756-837e-becbbabdffc5 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:34.480380 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef329e72-169a-4756-837e-becbbabdffc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:34.480652 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef329e72-169a-4756-837e-becbbabdffc5 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:34.481280 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef329e72-169a-4756-837e-becbbabdffc5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:34.481613 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef329e72-169a-4756-837e-becbbabdffc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:34.482994 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef329e72-169a-4756-837e-becbbabdffc5 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:34.515100 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 385/775] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:26:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:34.521036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1588890-0328-4b83-af6c-8d2beb4515a4 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:34.617133 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:34.632171 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1588890-0328-4b83-af6c-8d2beb4515a4 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:34.672150 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76339c-12f2-4904-98b5-a832a6c50c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:34.672763 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76339c-12f2-4904-98b5-a832a6c50c9d None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:34.673041 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76339c-12f2-4904-98b5-a832a6c50c9d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:34.673313 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76339c-12f2-4904-98b5-a832a6c50c9d None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:34.673947 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76339c-12f2-4904-98b5-a832a6c50c9d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:34.674251 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76339c-12f2-4904-98b5-a832a6c50c9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:34.675675 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76339c-12f2-4904-98b5-a832a6c50c9d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:34.681691 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 391/776] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:26:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:34.687843 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef329e72-169a-4756-837e-becbbabdffc5 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:34.809995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef329e72-169a-4756-837e-becbbabdffc5 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:34.849495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68265480-46c2-4b6c-91da-9a21f609bf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:34.850106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265480-46c2-4b6c-91da-9a21f609bf0a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:34.850382 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265480-46c2-4b6c-91da-9a21f609bf0a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:34.850653 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265480-46c2-4b6c-91da-9a21f609bf0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:34.851389 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68265480-46c2-4b6c-91da-9a21f609bf0a None admin] RBAC: Adding query filter params (interface=public, service_id=79397d603b204788a680963e80020336, region_id=RegionOne) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:34.851696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68265480-46c2-4b6c-91da-9a21f609bf0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:34.853650 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68265480-46c2-4b6c-91da-9a21f609bf0a None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:34.859411 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 386/777] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Aug 23 16:26:34 2022] GET /identity/v3/endpoints?service_id=79397d603b204788a680963e80020336&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:34.864605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76339c-12f2-4904-98b5-a832a6c50c9d None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:34.971282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76339c-12f2-4904-98b5-a832a6c50c9d None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:35.009731 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae997e-1625-407c-b7a1-da090aea7e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:35.010342 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae997e-1625-407c-b7a1-da090aea7e17 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:35.010618 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae997e-1625-407c-b7a1-da090aea7e17 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:35.010893 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae997e-1625-407c-b7a1-da090aea7e17 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:35.011535 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae997e-1625-407c-b7a1-da090aea7e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:35.012912 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae997e-1625-407c-b7a1-da090aea7e17 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:35.019255 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 392/778] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Aug 23 16:26:34 2022] GET /identity/v3/services => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:26:36.100338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8bf38-a717-4b27-86c3-77c38f788e44 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:36.100905 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8bf38-a717-4b27-86c3-77c38f788e44 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:36.100905 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8bf38-a717-4b27-86c3-77c38f788e44 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:36.102211 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 387/779] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:36.108789 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422023cf-1759-4974-b3d4-bddfded4a354 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:36.109282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422023cf-1759-4974-b3d4-bddfded4a354 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:36.109546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422023cf-1759-4974-b3d4-bddfded4a354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:36.129088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-422023cf-1759-4974-b3d4-bddfded4a354 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:36.130288 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-422023cf-1759-4974-b3d4-bddfded4a354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:36.140216 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:36.201615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 393/780] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:36 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:36.531465 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8bf38-a717-4b27-86c3-77c38f788e44 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:36.585707 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:36.635685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8bf38-a717-4b27-86c3-77c38f788e44 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:36.677836 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a964b8-3b97-401b-ac2b-edb6869ca821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:36.678487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a964b8-3b97-401b-ac2b-edb6869ca821 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:36.678833 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a964b8-3b97-401b-ac2b-edb6869ca821 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:36.679110 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a964b8-3b97-401b-ac2b-edb6869ca821 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:36.679724 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a964b8-3b97-401b-ac2b-edb6869ca821 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:36.681654 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a964b8-3b97-401b-ac2b-edb6869ca821 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-67a964b8-3b97-401b-ac2b-edb6869ca821 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:36.690360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:36.691472 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:36.692384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 388/781] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Aug 23 16:26:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:36.697608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422023cf-1759-4974-b3d4-bddfded4a354 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:36.803247 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422023cf-1759-4974-b3d4-bddfded4a354 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:36.843536 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7784ed-9e1a-48c8-8350-0df189f76bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:36.844141 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7784ed-9e1a-48c8-8350-0df189f76bac None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:36.844415 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7784ed-9e1a-48c8-8350-0df189f76bac None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:36.844682 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7784ed-9e1a-48c8-8350-0df189f76bac None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:36.845305 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7784ed-9e1a-48c8-8350-0df189f76bac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:36.845605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7784ed-9e1a-48c8-8350-0df189f76bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:36.846991 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7784ed-9e1a-48c8-8350-0df189f76bac None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:36.851775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 394/782] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Aug 23 16:26:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:36.858005 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a964b8-3b97-401b-ac2b-edb6869ca821 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:36.960949 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a964b8-3b97-401b-ac2b-edb6869ca821 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:36.978496 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:36.996557 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8ceaf-fbd9-498d-99c1-40dca853f550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:36.997305 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8ceaf-fbd9-498d-99c1-40dca853f550 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:36.997852 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8ceaf-fbd9-498d-99c1-40dca853f550 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:36.998226 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8ceaf-fbd9-498d-99c1-40dca853f550 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:36.998950 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8ceaf-fbd9-498d-99c1-40dca853f550 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:36.999409 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8ceaf-fbd9-498d-99c1-40dca853f550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:37.000876 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8ceaf-fbd9-498d-99c1-40dca853f550 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:37.006071 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 389/783] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Aug 23 16:26:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:37.012133 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7784ed-9e1a-48c8-8350-0df189f76bac None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:37.023090 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:37.116678 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7784ed-9e1a-48c8-8350-0df189f76bac None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:37.150387 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a724c-8f4b-4167-864a-bb5e3717f5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:37.150987 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a724c-8f4b-4167-864a-bb5e3717f5c9 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:37.151288 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a724c-8f4b-4167-864a-bb5e3717f5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:37.151558 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a724c-8f4b-4167-864a-bb5e3717f5c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:37.152202 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a724c-8f4b-4167-864a-bb5e3717f5c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:37.153548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a724c-8f4b-4167-864a-bb5e3717f5c9 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:37.246885 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 395/784] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Aug 23 16:26:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:26:37.249093 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85abb78-42fb-4b67-8751-fd2696c477a5 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:37.249628 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85abb78-42fb-4b67-8751-fd2696c477a5 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:37.249718 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85abb78-42fb-4b67-8751-fd2696c477a5 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:37.251208 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 390/785] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:37.257517 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bdcd7-077a-426b-88f1-74e5de8a7c2c None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:37.257797 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bdcd7-077a-426b-88f1-74e5de8a7c2c None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:37.258066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bdcd7-077a-426b-88f1-74e5de8a7c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:37.279755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-f10bdcd7-077a-426b-88f1-74e5de8a7c2c None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:37.281017 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-f10bdcd7-077a-426b-88f1-74e5de8a7c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:37.348888 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:37.370924 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 396/786] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:37 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:37.696261 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85abb78-42fb-4b67-8751-fd2696c477a5 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:37.805929 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85abb78-42fb-4b67-8751-fd2696c477a5 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:37.840509 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a346ca-ed1e-47db-ad57-cc929b1d5b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:37.841128 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a346ca-ed1e-47db-ad57-cc929b1d5b48 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:37.841407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a346ca-ed1e-47db-ad57-cc929b1d5b48 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:37.841676 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a346ca-ed1e-47db-ad57-cc929b1d5b48 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:37.842253 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a346ca-ed1e-47db-ad57-cc929b1d5b48 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:37.843638 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a346ca-ed1e-47db-ad57-cc929b1d5b48 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-24a346ca-ed1e-47db-ad57-cc929b1d5b48 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:37.852352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:37.853928 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:37.854787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 391/787] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:26:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:37.860020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bdcd7-077a-426b-88f1-74e5de8a7c2c None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:37.965720 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bdcd7-077a-426b-88f1-74e5de8a7c2c None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:38.000109 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c849a-37f0-47d5-9eee-9f574b7b3c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:38.000716 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c849a-37f0-47d5-9eee-9f574b7b3c57 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:38.000994 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c849a-37f0-47d5-9eee-9f574b7b3c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:38.001268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c849a-37f0-47d5-9eee-9f574b7b3c57 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:38.001906 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c849a-37f0-47d5-9eee-9f574b7b3c57 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:38.002211 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c849a-37f0-47d5-9eee-9f574b7b3c57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:38.003605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c849a-37f0-47d5-9eee-9f574b7b3c57 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:38.008323 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 397/788] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:26:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:38.014059 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a346ca-ed1e-47db-ad57-cc929b1d5b48 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:38.063214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:38.116721 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a346ca-ed1e-47db-ad57-cc929b1d5b48 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:38.153065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f0d1f-ac3a-49ee-9593-1b2dec53e1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:38.153680 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f0d1f-ac3a-49ee-9593-1b2dec53e1e1 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:38.153961 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f0d1f-ac3a-49ee-9593-1b2dec53e1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:38.154238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f0d1f-ac3a-49ee-9593-1b2dec53e1e1 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:38.154867 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f0d1f-ac3a-49ee-9593-1b2dec53e1e1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:38.155172 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f0d1f-ac3a-49ee-9593-1b2dec53e1e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:38.156573 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f0d1f-ac3a-49ee-9593-1b2dec53e1e1 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:38.161791 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 392/789] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Aug 23 16:26:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:38.167687 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c849a-37f0-47d5-9eee-9f574b7b3c57 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:38.228959 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:38.279694 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c849a-37f0-47d5-9eee-9f574b7b3c57 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:38.317580 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e8bd8-9a39-4c4e-8ce7-c65279d4c649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:38.318217 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e8bd8-9a39-4c4e-8ce7-c65279d4c649 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:38.318497 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e8bd8-9a39-4c4e-8ce7-c65279d4c649 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:38.318772 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e8bd8-9a39-4c4e-8ce7-c65279d4c649 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:38.319495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e8bd8-9a39-4c4e-8ce7-c65279d4c649 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:38.320903 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e8bd8-9a39-4c4e-8ce7-c65279d4c649 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:38.480605 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 398/790] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Aug 23 16:26:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:26:39.492139 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52586a94-7764-49ba-ba2a-8d2512a55bd5 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:39.492665 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52586a94-7764-49ba-ba2a-8d2512a55bd5 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:39.492665 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52586a94-7764-49ba-ba2a-8d2512a55bd5 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:39.494020 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 393/791] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:39.499540 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b588668-d67b-4fa3-9507-36ea7dc691ee None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:39.499935 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b588668-d67b-4fa3-9507-36ea7dc691ee None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:39.500396 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b588668-d67b-4fa3-9507-36ea7dc691ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:39.518963 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-3b588668-d67b-4fa3-9507-36ea7dc691ee None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:39.520170 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-3b588668-d67b-4fa3-9507-36ea7dc691ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:39.591986 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 399/792] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:39 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:39.926863 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52586a94-7764-49ba-ba2a-8d2512a55bd5 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:40.037443 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52586a94-7764-49ba-ba2a-8d2512a55bd5 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:40.047885 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:40.071866 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71db0f5-9476-4543-9be5-db552f7a69a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:40.072500 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db0f5-9476-4543-9be5-db552f7a69a1 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:40.072778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db0f5-9476-4543-9be5-db552f7a69a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:40.073063 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db0f5-9476-4543-9be5-db552f7a69a1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:40.073632 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71db0f5-9476-4543-9be5-db552f7a69a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:40.074989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71db0f5-9476-4543-9be5-db552f7a69a1 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-b71db0f5-9476-4543-9be5-db552f7a69a1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:40.083991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:40.085025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:40.086179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 394/793] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:40.091868 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b588668-d67b-4fa3-9507-36ea7dc691ee None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:40.125489 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:40.193362 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b588668-d67b-4fa3-9507-36ea7dc691ee None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:40.228056 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3672-b53f-42aa-a533-0e942632c530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:40.228669 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3672-b53f-42aa-a533-0e942632c530 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:40.228946 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3672-b53f-42aa-a533-0e942632c530 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:40.229215 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3672-b53f-42aa-a533-0e942632c530 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:40.229842 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3672-b53f-42aa-a533-0e942632c530 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:40.230144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3672-b53f-42aa-a533-0e942632c530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:40.231541 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3672-b53f-42aa-a533-0e942632c530 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:40.236339 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 400/794] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Aug 23 16:26:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:40.242121 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71db0f5-9476-4543-9be5-db552f7a69a1 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:40.342743 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71db0f5-9476-4543-9be5-db552f7a69a1 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:40.376836 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67600aff-842d-4ac3-a6cf-dc17bace71a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:40.377439 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67600aff-842d-4ac3-a6cf-dc17bace71a5 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:40.377719 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67600aff-842d-4ac3-a6cf-dc17bace71a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:40.377991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67600aff-842d-4ac3-a6cf-dc17bace71a5 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:40.378615 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67600aff-842d-4ac3-a6cf-dc17bace71a5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:40.378917 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67600aff-842d-4ac3-a6cf-dc17bace71a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:40.380312 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67600aff-842d-4ac3-a6cf-dc17bace71a5 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:40.385093 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 395/795] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Aug 23 16:26:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:26:40.725198 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c083a7-5af6-476b-a2a5-a95a56acb15a None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:40.725693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c083a7-5af6-476b-a2a5-a95a56acb15a None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:40.725778 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c083a7-5af6-476b-a2a5-a95a56acb15a None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:40.727044 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 401/796] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:40.733001 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779d254-5f75-4eb2-abc9-9af70412ade3 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:40.733453 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779d254-5f75-4eb2-abc9-9af70412ade3 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:40.733545 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779d254-5f75-4eb2-abc9-9af70412ade3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:40.753490 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-d779d254-5f75-4eb2-abc9-9af70412ade3 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:40.754695 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-d779d254-5f75-4eb2-abc9-9af70412ade3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:40.785671 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:40.824208 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 396/797] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:40 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:41.157584 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c083a7-5af6-476b-a2a5-a95a56acb15a None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:41.263476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:41.267423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c083a7-5af6-476b-a2a5-a95a56acb15a None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:41.308242 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96dc21-0a18-492a-a27c-fa9e137c549d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:41.308847 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96dc21-0a18-492a-a27c-fa9e137c549d None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:41.309125 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96dc21-0a18-492a-a27c-fa9e137c549d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:41.309392 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96dc21-0a18-492a-a27c-fa9e137c549d None admin] PATH_INFO: `/v3/projects` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:41.310038 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96dc21-0a18-492a-a27c-fa9e137c549d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:41.311532 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96dc21-0a18-492a-a27c-fa9e137c549d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:41.314133 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: WARNING keystone.server.flask.common [None req-bf96dc21-0a18-492a-a27c-fa9e137c549d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 16:26:41.370391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.sql.core [None req-bf96dc21-0a18-492a-a27c-fa9e137c549d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 16:26:41.370391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 16:26:41.370391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [parameters: {'id': 'e08148f640cf49528d8e5274ce9ff603', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 16:26:41.370391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88349) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 16:26:41.387822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-bf96dc21-0a18-492a-a27c-fa9e137c549d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e08148f640cf49528d8e5274ce9ff603.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e08148f640cf49528d8e5274ce9ff603. Aug 23 16:26:41.387822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:41.387822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:26:41.387822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:26:41.387822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:26:41.387822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:26:41.387822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:26:41.387822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:26:41.387822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:26:41.387822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:26:41.387822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:26:41.387822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:26:41.387822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application result.read() Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 16:26:41.388846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application yield resource Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise self.value Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application session.commit() Aug 23 16:26:41.391008 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self.session.flush() Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application compat.raise_( Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 16:26:41.392399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 16:26:41.393791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application result.read() Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:26:41.395124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [parameters: {'id': 'e08148f640cf49528d8e5274ce9ff603', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:41.402572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:41.404318 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:41.406252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:41.406252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 16:26:41.406252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 16:26:41.406252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:41.406252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:41.406252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 16:26:41.406252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 16:26:41.406252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e08148f640cf49528d8e5274ce9ff603. Aug 23 16:26:41.406252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:41.406252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 402/798] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Aug 23 16:26:41 2022] POST /identity/v3/projects => generated 262 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:41.408233 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779d254-5f75-4eb2-abc9-9af70412ade3 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:41.516755 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779d254-5f75-4eb2-abc9-9af70412ade3 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:41.560311 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9ab0a-6132-46eb-a781-8fa2454c6eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:41.560960 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9ab0a-6132-46eb-a781-8fa2454c6eda None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:41.561234 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9ab0a-6132-46eb-a781-8fa2454c6eda None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:41.561507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9ab0a-6132-46eb-a781-8fa2454c6eda None admin] PATH_INFO: `/v3/projects/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:41.569334 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9ab0a-6132-46eb-a781-8fa2454c6eda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:41.570803 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9ab0a-6132-46eb-a781-8fa2454c6eda None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-e1e9ab0a-6132-46eb-a781-8fa2454c6eda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:26:41.583553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:41.585513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:41.587894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:26:41.587894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:26:41.587894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:26:41.587894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:26:41.587894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:26:41.587894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:26:41.587894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:26:41.587894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:41.587894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 397/799] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:41.591884 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96dc21-0a18-492a-a27c-fa9e137c549d None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:41.702532 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96dc21-0a18-492a-a27c-fa9e137c549d None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:41.743608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922223b-783b-4696-9e54-c67937785b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:41.744580 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922223b-783b-4696-9e54-c67937785b6b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:41.744580 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922223b-783b-4696-9e54-c67937785b6b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:41.744871 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922223b-783b-4696-9e54-c67937785b6b None admin] PATH_INFO: `/v3/projects` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:41.745428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922223b-783b-4696-9e54-c67937785b6b None admin] RBAC: Adding query filter params (name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:41.745710 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922223b-783b-4696-9e54-c67937785b6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:41.747398 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922223b-783b-4696-9e54-c67937785b6b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:41.769791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 403/800] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Aug 23 16:26:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:42.597220 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d1ee7-25e2-4eda-b6e7-9a19bfc41dd9 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:42.597795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d1ee7-25e2-4eda-b6e7-9a19bfc41dd9 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:42.597795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d1ee7-25e2-4eda-b6e7-9a19bfc41dd9 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:42.599079 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 398/801] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:42.606287 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39a86a-4f28-48f8-b044-2134f4158adc None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:42.606782 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39a86a-4f28-48f8-b044-2134f4158adc None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:42.607428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39a86a-4f28-48f8-b044-2134f4158adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:42.626908 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-5c39a86a-4f28-48f8-b044-2134f4158adc None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:42.628490 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-5c39a86a-4f28-48f8-b044-2134f4158adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:42.641264 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:42.731460 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 404/802] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:42 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:43.058634 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d1ee7-25e2-4eda-b6e7-9a19bfc41dd9 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:43.089201 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:43.171861 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d1ee7-25e2-4eda-b6e7-9a19bfc41dd9 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:43.212518 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cc14c-23dc-4adb-92b3-4f585cbf9a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:43.213210 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cc14c-23dc-4adb-92b3-4f585cbf9a16 None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:43.213571 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cc14c-23dc-4adb-92b3-4f585cbf9a16 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:43.213926 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cc14c-23dc-4adb-92b3-4f585cbf9a16 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:43.214711 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cc14c-23dc-4adb-92b3-4f585cbf9a16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:43.216319 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cc14c-23dc-4adb-92b3-4f585cbf9a16 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:43.327148 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 399/803] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Aug 23 16:26:43 2022] POST /identity/v3/services => generated 242 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:26:44.131846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a2822-e9d9-4bcd-8832-ce80650fc4f7 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:44.132386 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a2822-e9d9-4bcd-8832-ce80650fc4f7 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:44.132738 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a2822-e9d9-4bcd-8832-ce80650fc4f7 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:44.135886 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 405/804] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:44.144606 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19267de-0206-4c85-a589-236f1573a226 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:44.145218 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19267de-0206-4c85-a589-236f1573a226 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:44.145218 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19267de-0206-4c85-a589-236f1573a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:44.166921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-c19267de-0206-4c85-a589-236f1573a226 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:44.168223 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-c19267de-0206-4c85-a589-236f1573a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:44.256301 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 400/805] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:44 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:44.590434 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a2822-e9d9-4bcd-8832-ce80650fc4f7 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:44.708018 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a2822-e9d9-4bcd-8832-ce80650fc4f7 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:44.750795 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131d562-073a-4a11-8202-8454e630d5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:44.751481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131d562-073a-4a11-8202-8454e630d5c9 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:44.751762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131d562-073a-4a11-8202-8454e630d5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:44.752081 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131d562-073a-4a11-8202-8454e630d5c9 None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:44.752739 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131d562-073a-4a11-8202-8454e630d5c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:44.754219 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131d562-073a-4a11-8202-8454e630d5c9 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:44.810677 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.sql.core [None req-0131d562-073a-4a11-8202-8454e630d5c9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 16:26:44.810677 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 16:26:44.810677 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [parameters: {'user_id': '306f0397f13246e981e1056aa53cc26a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 16:26:44.810677 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88349) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-0131d562-073a-4a11-8202-8454e630d5c9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application result.read() Aug 23 16:26:44.817368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:26:44.818307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application yield resource Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise self.value Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application session.commit() Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 16:26:44.819336 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self.session.flush() Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application compat.raise_( Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 16:26:44.820300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:26:44.821976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application result.read() Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:26:44.822833 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [parameters: {'user_id': '306f0397f13246e981e1056aa53cc26a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:44.824775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 16:26:44.826367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 16:26:44.828629 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 16:26:44.828629 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 16:26:44.828629 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 16:26:44.828629 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 16:26:44.828629 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 16:26:44.828629 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:44.828629 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 406/806] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Aug 23 16:26:44 2022] POST /identity/v3/users => generated 160 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:44.830400 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19267de-0206-4c85-a589-236f1573a226 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:44.841000 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:44.959600 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19267de-0206-4c85-a589-236f1573a226 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:44.999385 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c00b2-757e-42e2-bc19-1c29c66f99fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:45.000033 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c00b2-757e-42e2-bc19-1c29c66f99fc None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:45.000312 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c00b2-757e-42e2-bc19-1c29c66f99fc None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:45.000587 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c00b2-757e-42e2-bc19-1c29c66f99fc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:45.008727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c00b2-757e-42e2-bc19-1c29c66f99fc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:45.010197 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c00b2-757e-42e2-bc19-1c29c66f99fc None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-4c0c00b2-757e-42e2-bc19-1c29c66f99fc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:26:45.022780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:45.024778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:45.027138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:45.027138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:45.027138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:26:45.027138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:26:45.027138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:26:45.027138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:26:45.027138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:26:45.027138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:26:45.027138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:26:45.027138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:45.027138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 401/807] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:26:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:45.030378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131d562-073a-4a11-8202-8454e630d5c9 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:45.044161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:45.143908 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131d562-073a-4a11-8202-8454e630d5c9 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:45.182811 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b41134-e70e-4439-ad01-8d1bd1d0065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:45.183458 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41134-e70e-4439-ad01-8d1bd1d0065c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:45.183741 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41134-e70e-4439-ad01-8d1bd1d0065c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:45.184014 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41134-e70e-4439-ad01-8d1bd1d0065c None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:45.184724 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b41134-e70e-4439-ad01-8d1bd1d0065c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:45.185028 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b41134-e70e-4439-ad01-8d1bd1d0065c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:45.186731 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b41134-e70e-4439-ad01-8d1bd1d0065c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:45.238818 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 407/808] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Aug 23 16:26:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:45.621992 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceea7f-3459-4b2d-b187-bdace6b8bd12 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:45.622540 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceea7f-3459-4b2d-b187-bdace6b8bd12 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:45.622540 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceea7f-3459-4b2d-b187-bdace6b8bd12 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:45.623973 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 402/809] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:45.630211 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65eaaf-ddf1-4249-8f82-32f40d99e599 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:45.630493 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65eaaf-ddf1-4249-8f82-32f40d99e599 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:45.630771 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65eaaf-ddf1-4249-8f82-32f40d99e599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:45.650587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-af65eaaf-ddf1-4249-8f82-32f40d99e599 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:45.652171 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-af65eaaf-ddf1-4249-8f82-32f40d99e599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:45.713700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:45.721331 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 408/810] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:45 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:26:46.050387 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baceea7f-3459-4b2d-b187-bdace6b8bd12 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:46.121002 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:46.151781 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baceea7f-3459-4b2d-b187-bdace6b8bd12 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:46.186826 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5e49e-4459-4e65-a649-eeb93249eca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:46.187470 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5e49e-4459-4e65-a649-eeb93249eca9 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:46.187746 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5e49e-4459-4e65-a649-eeb93249eca9 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:46.188014 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5e49e-4459-4e65-a649-eeb93249eca9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:46.188583 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5e49e-4459-4e65-a649-eeb93249eca9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:46.189935 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5e49e-4459-4e65-a649-eeb93249eca9 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-66c5e49e-4459-4e65-a649-eeb93249eca9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:46.198971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:46.200282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:26:46.201421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 403/811] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:46.206090 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65eaaf-ddf1-4249-8f82-32f40d99e599 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:46.313997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65eaaf-ddf1-4249-8f82-32f40d99e599 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:46.349193 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0d0d0-31a5-4e26-8a67-d972c6518bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:46.349797 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0d0d0-31a5-4e26-8a67-d972c6518bd1 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:46.350090 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0d0d0-31a5-4e26-8a67-d972c6518bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:46.350347 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0d0d0-31a5-4e26-8a67-d972c6518bd1 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:46.350973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0d0d0-31a5-4e26-8a67-d972c6518bd1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:46.351301 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0d0d0-31a5-4e26-8a67-d972c6518bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:46.353193 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0d0d0-31a5-4e26-8a67-d972c6518bd1 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:46.358060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 409/812] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Aug 23 16:26:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:46.364009 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5e49e-4459-4e65-a649-eeb93249eca9 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:46.464212 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5e49e-4459-4e65-a649-eeb93249eca9 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:46.499869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f214b13-7342-4d96-9d02-1c1c7d102f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:46.500477 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f214b13-7342-4d96-9d02-1c1c7d102f48 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:46.500752 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f214b13-7342-4d96-9d02-1c1c7d102f48 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:46.501020 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f214b13-7342-4d96-9d02-1c1c7d102f48 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:46.501637 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f214b13-7342-4d96-9d02-1c1c7d102f48 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:46.501934 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f214b13-7342-4d96-9d02-1c1c7d102f48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:46.503313 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f214b13-7342-4d96-9d02-1c1c7d102f48 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:46.505435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:46.508784 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 404/813] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Aug 23 16:26:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:46.515099 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0d0d0-31a5-4e26-8a67-d972c6518bd1 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:46.578657 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:46.619736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0d0d0-31a5-4e26-8a67-d972c6518bd1 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:46.652686 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b663eb-61d5-4210-8457-a18962137ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:46.653279 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b663eb-61d5-4210-8457-a18962137ac6 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:46.653551 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b663eb-61d5-4210-8457-a18962137ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:46.653818 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b663eb-61d5-4210-8457-a18962137ac6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:46.654503 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b663eb-61d5-4210-8457-a18962137ac6 None admin] RBAC: Adding query filter params (interface=public, service_id=112f32af5cb94873b73b9a9cdc1afdd7, region_id=RegionOne) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:46.654806 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b663eb-61d5-4210-8457-a18962137ac6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:46.656187 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b663eb-61d5-4210-8457-a18962137ac6 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:46.661107 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 410/814] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Aug 23 16:26:46 2022] GET /identity/v3/endpoints?service_id=112f32af5cb94873b73b9a9cdc1afdd7&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:46.667533 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f214b13-7342-4d96-9d02-1c1c7d102f48 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:46.771885 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f214b13-7342-4d96-9d02-1c1c7d102f48 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:46.805459 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c819a-fc9a-4dd7-98f2-3e5090feb555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:46.806055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c819a-fc9a-4dd7-98f2-3e5090feb555 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:46.806330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c819a-fc9a-4dd7-98f2-3e5090feb555 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:46.806599 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c819a-fc9a-4dd7-98f2-3e5090feb555 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:46.807193 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c819a-fc9a-4dd7-98f2-3e5090feb555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:46.808572 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c819a-fc9a-4dd7-98f2-3e5090feb555 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:46.814588 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 405/815] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Aug 23 16:26:46 2022] GET /identity/v3/services => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:26:49.058524 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495f906-23a3-4fa9-b789-4b498e5ecba2 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:49.059064 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495f906-23a3-4fa9-b789-4b498e5ecba2 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:49.059064 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495f906-23a3-4fa9-b789-4b498e5ecba2 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:49.060429 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 411/816] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:49.065642 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6336f43-43fd-4fbc-9894-f8ce1859f219 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:49.066081 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6336f43-43fd-4fbc-9894-f8ce1859f219 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:49.066278 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6336f43-43fd-4fbc-9894-f8ce1859f219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:49.084402 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-e6336f43-43fd-4fbc-9894-f8ce1859f219 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:49.085616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-e6336f43-43fd-4fbc-9894-f8ce1859f219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:49.149983 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:49.158514 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 406/817] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:49 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:26:49.490569 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495f906-23a3-4fa9-b789-4b498e5ecba2 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:49.605309 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495f906-23a3-4fa9-b789-4b498e5ecba2 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:49.657729 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:49.673608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3423e0-ea2c-4c5a-a11a-30d233edf1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:49.674343 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3423e0-ea2c-4c5a-a11a-30d233edf1cc None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:49.674623 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3423e0-ea2c-4c5a-a11a-30d233edf1cc None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:49.674897 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3423e0-ea2c-4c5a-a11a-30d233edf1cc None admin] PATH_INFO: `/v3/services/compute` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:49.675565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3423e0-ea2c-4c5a-a11a-30d233edf1cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:49.677885 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3423e0-ea2c-4c5a-a11a-30d233edf1cc None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-3c3423e0-ea2c-4c5a-a11a-30d233edf1cc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:26:49.692231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:26:49.693515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:26:49.694621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 412/818] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:26:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:26:49.701145 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6336f43-43fd-4fbc-9894-f8ce1859f219 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:49.863043 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6336f43-43fd-4fbc-9894-f8ce1859f219 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:49.906738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825304bf-3af7-4fe6-855e-0e3cee897ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:49.907373 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825304bf-3af7-4fe6-855e-0e3cee897ac3 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:49.907651 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825304bf-3af7-4fe6-855e-0e3cee897ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:49.907922 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825304bf-3af7-4fe6-855e-0e3cee897ac3 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:49.908549 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825304bf-3af7-4fe6-855e-0e3cee897ac3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:49.908849 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825304bf-3af7-4fe6-855e-0e3cee897ac3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:49.910219 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825304bf-3af7-4fe6-855e-0e3cee897ac3 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:49.915670 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 407/819] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Aug 23 16:26:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:49.921556 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3423e0-ea2c-4c5a-a11a-30d233edf1cc None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:50.029224 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3423e0-ea2c-4c5a-a11a-30d233edf1cc None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:50.069489 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7958a0-8c4e-46b9-bbdf-5885e676c573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:50.070290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7958a0-8c4e-46b9-bbdf-5885e676c573 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:50.070753 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7958a0-8c4e-46b9-bbdf-5885e676c573 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:50.071038 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7958a0-8c4e-46b9-bbdf-5885e676c573 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:50.071864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7958a0-8c4e-46b9-bbdf-5885e676c573 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:26:50.072171 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7958a0-8c4e-46b9-bbdf-5885e676c573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:50.073670 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7958a0-8c4e-46b9-bbdf-5885e676c573 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:50.080610 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 413/820] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Aug 23 16:26:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:26:50.087144 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825304bf-3af7-4fe6-855e-0e3cee897ac3 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:50.146138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:50.188441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825304bf-3af7-4fe6-855e-0e3cee897ac3 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:50.225548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3c4a9-650e-495c-93f8-e9c78d76970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:50.226168 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c4a9-650e-495c-93f8-e9c78d76970d None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:50.226438 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c4a9-650e-495c-93f8-e9c78d76970d None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:50.226704 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c4a9-650e-495c-93f8-e9c78d76970d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:50.227441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3c4a9-650e-495c-93f8-e9c78d76970d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:50.228814 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3c4a9-650e-495c-93f8-e9c78d76970d None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:50.362835 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 408/821] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Aug 23 16:26:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:27:00.077937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=74 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:00.358283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:24.134143 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f350b0-7f5a-4c2f-9ea6-18f6ee93fa7b None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:24.134755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f350b0-7f5a-4c2f-9ea6-18f6ee93fa7b None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:24.134755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f350b0-7f5a-4c2f-9ea6-18f6ee93fa7b None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:24.136065 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 414/822] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:24.141969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de457b-1ab0-4f71-86c1-962231525eb3 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:24.142433 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de457b-1ab0-4f71-86c1-962231525eb3 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:24.142530 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de457b-1ab0-4f71-86c1-962231525eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:24.161681 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-01de457b-1ab0-4f71-86c1-962231525eb3 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:24.166818 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-01de457b-1ab0-4f71-86c1-962231525eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:24.243402 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 409/823] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:28:24 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:28:24.572276 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f350b0-7f5a-4c2f-9ea6-18f6ee93fa7b None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:24.673694 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f350b0-7f5a-4c2f-9ea6-18f6ee93fa7b None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:24.710023 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82a4cb-9b71-49ac-b9b9-2e87faa5ce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:24.710639 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82a4cb-9b71-49ac-b9b9-2e87faa5ce82 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:24.710915 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82a4cb-9b71-49ac-b9b9-2e87faa5ce82 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:24.711186 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82a4cb-9b71-49ac-b9b9-2e87faa5ce82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:24.721108 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82a4cb-9b71-49ac-b9b9-2e87faa5ce82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:24.722553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82a4cb-9b71-49ac-b9b9-2e87faa5ce82 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-1d82a4cb-9b71-49ac-b9b9-2e87faa5ce82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:28:24.737223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:24.738268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:28:24.739279 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:28:24.739279 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:24.739279 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:24.739279 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 415/824] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:24.745125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de457b-1ab0-4f71-86c1-962231525eb3 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:24.844667 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de457b-1ab0-4f71-86c1-962231525eb3 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:24.869261 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:24.877819 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48a7ee-6241-4f64-889e-873e576222ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:24.878411 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48a7ee-6241-4f64-889e-873e576222ef None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:24.878684 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48a7ee-6241-4f64-889e-873e576222ef None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:24.878954 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48a7ee-6241-4f64-889e-873e576222ef None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:24.879616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48a7ee-6241-4f64-889e-873e576222ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:24.879913 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48a7ee-6241-4f64-889e-873e576222ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:24.881261 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48a7ee-6241-4f64-889e-873e576222ef None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:24.892996 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 410/825] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:24.899220 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82a4cb-9b71-49ac-b9b9-2e87faa5ce82 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:24.958789 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:25.006162 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82a4cb-9b71-49ac-b9b9-2e87faa5ce82 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:25.039854 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370da1e5-e5e4-4ef6-966d-8e41e03b6410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:25.043349 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370da1e5-e5e4-4ef6-966d-8e41e03b6410 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:25.043349 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370da1e5-e5e4-4ef6-966d-8e41e03b6410 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:25.043349 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370da1e5-e5e4-4ef6-966d-8e41e03b6410 None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:25.043349 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370da1e5-e5e4-4ef6-966d-8e41e03b6410 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:25.043349 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370da1e5-e5e4-4ef6-966d-8e41e03b6410 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:25.267892 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 416/826] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Aug 23 16:28:24 2022] POST /identity/v3/users => generated 251 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:28:27.462247 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388bf02-82b4-47c0-a672-43562cc34279 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:27.462783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388bf02-82b4-47c0-a672-43562cc34279 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:27.462783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388bf02-82b4-47c0-a672-43562cc34279 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:27.464155 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 411/827] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:27.469574 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ffefd-0b75-41aa-88bf-b1e0aa08b30b None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:27.470013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ffefd-0b75-41aa-88bf-b1e0aa08b30b None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:27.470157 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ffefd-0b75-41aa-88bf-b1e0aa08b30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:27.488751 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-7b8ffefd-0b75-41aa-88bf-b1e0aa08b30b None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:27.489943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-7b8ffefd-0b75-41aa-88bf-b1e0aa08b30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:27.561076 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 417/828] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:28:27 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:28:27.933723 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388bf02-82b4-47c0-a672-43562cc34279 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:28.060461 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388bf02-82b4-47c0-a672-43562cc34279 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:28.086421 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc6c42-a6f7-4dc8-a9a2-127092d10bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:28.087101 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc6c42-a6f7-4dc8-a9a2-127092d10bca None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:28.087437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc6c42-a6f7-4dc8-a9a2-127092d10bca None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:28.087715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc6c42-a6f7-4dc8-a9a2-127092d10bca None admin] PATH_INFO: `/v3/roles/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:28.098890 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc6c42-a6f7-4dc8-a9a2-127092d10bca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-92dc6c42-a6f7-4dc8-a9a2-127092d10bca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:28:28.104032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:28.105216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:28.106268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:28.106268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:28.106268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:28.106268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:28.106268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:28:28.106268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:28:28.106268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:28:28.106268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:28:28.106268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:28:28.106268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:28:28.106268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:28:28.106268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:28.106268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 412/829] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:28:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:28.112476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ffefd-0b75-41aa-88bf-b1e0aa08b30b None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:28.152114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:28.210001 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ffefd-0b75-41aa-88bf-b1e0aa08b30b None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:28.247401 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211ff09-66d8-4917-807b-c51690e6089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:28.248089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211ff09-66d8-4917-807b-c51690e6089a None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:28.248419 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211ff09-66d8-4917-807b-c51690e6089a None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:28.248746 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211ff09-66d8-4917-807b-c51690e6089a None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:28.249511 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211ff09-66d8-4917-807b-c51690e6089a None admin] RBAC: Adding query filter params (name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:28.249876 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211ff09-66d8-4917-807b-c51690e6089a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:28.251462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211ff09-66d8-4917-807b-c51690e6089a None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:28.260306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 418/830] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:28.266338 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc6c42-a6f7-4dc8-a9a2-127092d10bca None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:28.313183 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:28.364759 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc6c42-a6f7-4dc8-a9a2-127092d10bca None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:28.399874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660dae-815d-4894-b60e-6df68e08d4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:28.400575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660dae-815d-4894-b60e-6df68e08d4d4 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:28.400854 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660dae-815d-4894-b60e-6df68e08d4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:28.401162 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660dae-815d-4894-b60e-6df68e08d4d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:28.413915 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8660dae-815d-4894-b60e-6df68e08d4d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:28.415550 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8660dae-815d-4894-b60e-6df68e08d4d4 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-a8660dae-815d-4894-b60e-6df68e08d4d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:28:28.431763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:28.432927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:28:28.434227 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:28:28.434227 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:28.434227 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:28.434227 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 413/831] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:28.439698 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211ff09-66d8-4917-807b-c51690e6089a None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:28.555554 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211ff09-66d8-4917-807b-c51690e6089a None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:28.592514 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479a982-d1c4-41e1-b159-3f13fb028c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:28.593080 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479a982-d1c4-41e1-b159-3f13fb028c92 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:28.593360 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479a982-d1c4-41e1-b159-3f13fb028c92 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:28.593637 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479a982-d1c4-41e1-b159-3f13fb028c92 None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:28.594268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479a982-d1c4-41e1-b159-3f13fb028c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:28.594575 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479a982-d1c4-41e1-b159-3f13fb028c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:28.595959 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479a982-d1c4-41e1-b159-3f13fb028c92 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:28.607406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 419/832] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:28.613791 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660dae-815d-4894-b60e-6df68e08d4d4 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:28.716478 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:28.720802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660dae-815d-4894-b60e-6df68e08d4d4 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:28.757909 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2427083-4b85-4a95-b31b-53c04ff26a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:28.758543 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2427083-4b85-4a95-b31b-53c04ff26a42 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:28.758923 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2427083-4b85-4a95-b31b-53c04ff26a42 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:28.759279 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2427083-4b85-4a95-b31b-53c04ff26a42 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:28.766712 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2427083-4b85-4a95-b31b-53c04ff26a42 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:28.768183 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2427083-4b85-4a95-b31b-53c04ff26a42 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-b2427083-4b85-4a95-b31b-53c04ff26a42 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:28:28.779507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:28.782857 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:28.784125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:28.784125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:28.784125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:28:28.784125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:28:28.784125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:28:28.784125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:28:28.784125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:28:28.784125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:28:28.784125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:28:28.784125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:28.784125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 414/833] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:28.786667 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479a982-d1c4-41e1-b159-3f13fb028c92 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:28.804734 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:28.893983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479a982-d1c4-41e1-b159-3f13fb028c92 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:28.929269 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4591adf-7969-45f5-8523-283ff94db0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:28.929940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4591adf-7969-45f5-8523-283ff94db0ff None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:28.930252 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4591adf-7969-45f5-8523-283ff94db0ff None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:28.930560 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4591adf-7969-45f5-8523-283ff94db0ff None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:28.931388 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4591adf-7969-45f5-8523-283ff94db0ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:28.931698 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4591adf-7969-45f5-8523-283ff94db0ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:28.933258 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4591adf-7969-45f5-8523-283ff94db0ff None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:28.950588 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 420/834] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Aug 23 16:28:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:28.956632 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2427083-4b85-4a95-b31b-53c04ff26a42 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:29.058131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2427083-4b85-4a95-b31b-53c04ff26a42 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:29.091497 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040ae1c-2d4b-417e-8988-252e5204527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:29.092102 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040ae1c-2d4b-417e-8988-252e5204527b None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:29.092385 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040ae1c-2d4b-417e-8988-252e5204527b None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:29.093187 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040ae1c-2d4b-417e-8988-252e5204527b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:29.120509 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:29.164054 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040ae1c-2d4b-417e-8988-252e5204527b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:29.165429 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040ae1c-2d4b-417e-8988-252e5204527b None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:29.266348 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 415/835] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:28:28 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:28:29.272807 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4591adf-7969-45f5-8523-283ff94db0ff None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:29.292050 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:29.369716 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4591adf-7969-45f5-8523-283ff94db0ff None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:29.408522 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc940320-f10f-4458-b1b8-7e31eb2641f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:29.409275 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940320-f10f-4458-b1b8-7e31eb2641f3 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:29.409579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940320-f10f-4458-b1b8-7e31eb2641f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:29.409888 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940320-f10f-4458-b1b8-7e31eb2641f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:29.427855 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc940320-f10f-4458-b1b8-7e31eb2641f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:29.427855 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc940320-f10f-4458-b1b8-7e31eb2641f3 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-fc940320-f10f-4458-b1b8-7e31eb2641f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:28:29.438537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:29.439661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:28:29.440800 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:28:29.440800 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:29.440800 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:29.440800 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 421/836] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:29.446607 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040ae1c-2d4b-417e-8988-252e5204527b None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:29.509824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:29.553864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040ae1c-2d4b-417e-8988-252e5204527b None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:29.586814 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b164755-a544-4377-b9df-e62d1a2ab95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:29.587435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b164755-a544-4377-b9df-e62d1a2ab95a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:29.587718 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b164755-a544-4377-b9df-e62d1a2ab95a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:29.587991 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b164755-a544-4377-b9df-e62d1a2ab95a None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:29.588623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b164755-a544-4377-b9df-e62d1a2ab95a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:29.588934 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b164755-a544-4377-b9df-e62d1a2ab95a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:29.590283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b164755-a544-4377-b9df-e62d1a2ab95a None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:29.601617 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 416/837] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:29.607399 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc940320-f10f-4458-b1b8-7e31eb2641f3 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:29.675949 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:29.706612 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc940320-f10f-4458-b1b8-7e31eb2641f3 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:29.740367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb85d9-cd89-4682-a1dd-1873a3cf824b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:29.740983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb85d9-cd89-4682-a1dd-1873a3cf824b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:29.741256 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb85d9-cd89-4682-a1dd-1873a3cf824b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:29.741528 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb85d9-cd89-4682-a1dd-1873a3cf824b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:29.748002 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb85d9-cd89-4682-a1dd-1873a3cf824b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:29.749959 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb85d9-cd89-4682-a1dd-1873a3cf824b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-2bfb85d9-cd89-4682-a1dd-1873a3cf824b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:28:29.761168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:29.762250 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:29.763137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:28:29.763137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:28:29.763137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:28:29.763137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:28:29.763137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:28:29.763137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:28:29.763137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:28:29.763137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:29.763137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 422/838] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:29.768947 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b164755-a544-4377-b9df-e62d1a2ab95a None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:29.873248 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b164755-a544-4377-b9df-e62d1a2ab95a None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:29.891716 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:29.909640 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f861dfe-c49c-4a6c-aa3a-0ff63b283ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:29.910214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f861dfe-c49c-4a6c-aa3a-0ff63b283ee9 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:29.910489 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f861dfe-c49c-4a6c-aa3a-0ff63b283ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:29.910759 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f861dfe-c49c-4a6c-aa3a-0ff63b283ee9 None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:29.911603 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f861dfe-c49c-4a6c-aa3a-0ff63b283ee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:29.911914 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f861dfe-c49c-4a6c-aa3a-0ff63b283ee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:29.913346 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f861dfe-c49c-4a6c-aa3a-0ff63b283ee9 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:29.925897 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 417/839] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:29.932214 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb85d9-cd89-4682-a1dd-1873a3cf824b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:30.034221 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb85d9-cd89-4682-a1dd-1873a3cf824b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:30.064543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:30.073400 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d9d9-17c6-4b87-b56b-e99be7e0737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:30.074014 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d9d9-17c6-4b87-b56b-e99be7e0737f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:30.074299 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d9d9-17c6-4b87-b56b-e99be7e0737f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:30.074575 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d9d9-17c6-4b87-b56b-e99be7e0737f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:30.075337 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d9d9-17c6-4b87-b56b-e99be7e0737f None admin] RBAC: Adding query filter params (role.id=2d13d41360794cff9c85249999f92061, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=eef56a81a66744b2a3e468b7f182f9ef) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:30.075648 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d9d9-17c6-4b87-b56b-e99be7e0737f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:30.077727 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d9d9-17c6-4b87-b56b-e99be7e0737f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:30.083480 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 423/840] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:28:29 2022] GET /identity/v3/role_assignments?user.id=eef56a81a66744b2a3e468b7f182f9ef&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=2d13d41360794cff9c85249999f92061 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:32.280717 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829165-aee4-417a-9fab-0c54f53063ba None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:32.281293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829165-aee4-417a-9fab-0c54f53063ba None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:32.281293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829165-aee4-417a-9fab-0c54f53063ba None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:32.282895 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 418/841] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:32.288371 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140f2a9-3ce4-4ee4-bca3-98de3afac14e None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:32.296127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140f2a9-3ce4-4ee4-bca3-98de3afac14e None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:32.296127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140f2a9-3ce4-4ee4-bca3-98de3afac14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:32.306737 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-0140f2a9-3ce4-4ee4-bca3-98de3afac14e None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:32.307979 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-0140f2a9-3ce4-4ee4-bca3-98de3afac14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:32.374659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 424/842] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:28:32 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:28:32.742834 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67829165-aee4-417a-9fab-0c54f53063ba None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:32.847250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67829165-aee4-417a-9fab-0c54f53063ba None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:32.881559 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096ddb8-7398-4d09-90fd-8064b277738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:32.881997 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096ddb8-7398-4d09-90fd-8064b277738e None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:32.882282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096ddb8-7398-4d09-90fd-8064b277738e None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:32.882550 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096ddb8-7398-4d09-90fd-8064b277738e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:32.892920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096ddb8-7398-4d09-90fd-8064b277738e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-6096ddb8-7398-4d09-90fd-8064b277738e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:28:32.897892 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:32.903318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:32.904431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:32.904431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:32.904431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:32.904431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:32.904431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:28:32.904431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:28:32.904431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:28:32.904431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:28:32.904431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:28:32.904431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:28:32.904431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:28:32.904431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:32.904431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 419/843] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:28:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:32.907216 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140f2a9-3ce4-4ee4-bca3-98de3afac14e None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:33.007019 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140f2a9-3ce4-4ee4-bca3-98de3afac14e None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:33.031353 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:33.041668 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb433b7-4ebf-47d6-b300-c7b1d7e3cd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:33.042272 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb433b7-4ebf-47d6-b300-c7b1d7e3cd59 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:33.042551 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb433b7-4ebf-47d6-b300-c7b1d7e3cd59 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:33.042860 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb433b7-4ebf-47d6-b300-c7b1d7e3cd59 None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:33.043504 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb433b7-4ebf-47d6-b300-c7b1d7e3cd59 None admin] RBAC: Adding query filter params (name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:33.043815 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb433b7-4ebf-47d6-b300-c7b1d7e3cd59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:33.045179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb433b7-4ebf-47d6-b300-c7b1d7e3cd59 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:33.052980 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 425/844] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:28:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:33.059003 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096ddb8-7398-4d09-90fd-8064b277738e None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:33.102759 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:33.165595 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096ddb8-7398-4d09-90fd-8064b277738e None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:33.200187 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc709-f9c7-4ed2-b913-efb0784e1f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:33.200841 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc709-f9c7-4ed2-b913-efb0784e1f58 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:33.201121 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc709-f9c7-4ed2-b913-efb0784e1f58 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:33.201430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc709-f9c7-4ed2-b913-efb0784e1f58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:33.214374 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdc709-f9c7-4ed2-b913-efb0784e1f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:33.216007 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdc709-f9c7-4ed2-b913-efb0784e1f58 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-0afdc709-f9c7-4ed2-b913-efb0784e1f58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:28:33.232487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:33.233674 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:28:33.234657 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:28:33.234657 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:33.234657 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:33.234657 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 420/845] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:33.240043 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb433b7-4ebf-47d6-b300-c7b1d7e3cd59 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:33.343309 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb433b7-4ebf-47d6-b300-c7b1d7e3cd59 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:33.377335 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae1308-aeec-432d-bd41-66afee6b762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:33.377934 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae1308-aeec-432d-bd41-66afee6b762c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:33.378209 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae1308-aeec-432d-bd41-66afee6b762c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:33.378480 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae1308-aeec-432d-bd41-66afee6b762c None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:33.379107 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae1308-aeec-432d-bd41-66afee6b762c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:33.379438 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae1308-aeec-432d-bd41-66afee6b762c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:33.380866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae1308-aeec-432d-bd41-66afee6b762c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:33.393381 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 426/846] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:33.399599 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc709-f9c7-4ed2-b913-efb0784e1f58 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:33.491238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:33.501587 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc709-f9c7-4ed2-b913-efb0784e1f58 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:33.537787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7407928-5c5d-4849-8eb3-a4beb9679149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:33.538417 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7407928-5c5d-4849-8eb3-a4beb9679149 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:33.538738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7407928-5c5d-4849-8eb3-a4beb9679149 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:33.539049 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7407928-5c5d-4849-8eb3-a4beb9679149 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:33.547152 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7407928-5c5d-4849-8eb3-a4beb9679149 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:33.548744 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7407928-5c5d-4849-8eb3-a4beb9679149 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-c7407928-5c5d-4849-8eb3-a4beb9679149 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:28:33.560075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:33.561824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:33.562982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:33.562982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:33.562982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:28:33.562982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:28:33.562982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:28:33.562982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:28:33.562982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:28:33.562982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:28:33.562982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:28:33.562982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:33.562982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 421/847] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:33.568093 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae1308-aeec-432d-bd41-66afee6b762c None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:33.618288 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:33.669910 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae1308-aeec-432d-bd41-66afee6b762c None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:33.702940 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a9711-cb9e-426d-b3ef-2e7953de06e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:33.726451 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a9711-cb9e-426d-b3ef-2e7953de06e3 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:33.726451 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a9711-cb9e-426d-b3ef-2e7953de06e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:33.726451 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a9711-cb9e-426d-b3ef-2e7953de06e3 None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:33.726451 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a9711-cb9e-426d-b3ef-2e7953de06e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:33.726451 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a9711-cb9e-426d-b3ef-2e7953de06e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:33.726451 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a9711-cb9e-426d-b3ef-2e7953de06e3 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:33.726978 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 427/848] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Aug 23 16:28:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:33.728601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7407928-5c5d-4849-8eb3-a4beb9679149 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:33.828861 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7407928-5c5d-4849-8eb3-a4beb9679149 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:33.866276 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4d066-9a73-43b2-bd77-af94c5780641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:33.866925 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4d066-9a73-43b2-bd77-af94c5780641 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:33.867187 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4d066-9a73-43b2-bd77-af94c5780641 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:33.867491 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4d066-9a73-43b2-bd77-af94c5780641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:33.880431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4d066-9a73-43b2-bd77-af94c5780641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:33.880431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4d066-9a73-43b2-bd77-af94c5780641 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-0ea4d066-9a73-43b2-bd77-af94c5780641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:28:33.894268 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:33.895448 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:28:33.896800 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:28:33.896800 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:33.896800 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:33.896800 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 422/849] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:33.901480 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a9711-cb9e-426d-b3ef-2e7953de06e3 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:33.999567 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a9711-cb9e-426d-b3ef-2e7953de06e3 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:34.001803 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:34.033650 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dfa29-625c-4b2f-828c-1beb146f157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:34.034242 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dfa29-625c-4b2f-828c-1beb146f157a None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:34.034517 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dfa29-625c-4b2f-828c-1beb146f157a None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:34.034785 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dfa29-625c-4b2f-828c-1beb146f157a None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:34.035436 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dfa29-625c-4b2f-828c-1beb146f157a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:34.035736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dfa29-625c-4b2f-828c-1beb146f157a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:34.037194 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dfa29-625c-4b2f-828c-1beb146f157a None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:34.048010 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 428/850] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:34.053782 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4d066-9a73-43b2-bd77-af94c5780641 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:34.056773 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:34.152389 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4d066-9a73-43b2-bd77-af94c5780641 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:34.184219 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568f5bc-d0ba-4434-b1f7-149dfa43b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:34.184834 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568f5bc-d0ba-4434-b1f7-149dfa43b9ea None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:34.185108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568f5bc-d0ba-4434-b1f7-149dfa43b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:34.185423 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568f5bc-d0ba-4434-b1f7-149dfa43b9ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:34.192735 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568f5bc-d0ba-4434-b1f7-149dfa43b9ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:34.194170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568f5bc-d0ba-4434-b1f7-149dfa43b9ea None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-d568f5bc-d0ba-4434-b1f7-149dfa43b9ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:28:34.205989 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:34.209655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:34.210766 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:28:34.210766 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:28:34.210766 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:28:34.210766 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:28:34.210766 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:28:34.210766 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:28:34.210766 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:28:34.210766 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:34.210766 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 423/851] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:28:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:34.213206 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dfa29-625c-4b2f-828c-1beb146f157a None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:34.311735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dfa29-625c-4b2f-828c-1beb146f157a None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:34.343947 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f5d99-95b8-47a4-bde2-6eef52c81980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:34.344555 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f5d99-95b8-47a4-bde2-6eef52c81980 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:34.344802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f5d99-95b8-47a4-bde2-6eef52c81980 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:34.345071 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f5d99-95b8-47a4-bde2-6eef52c81980 None admin] PATH_INFO: `/v3/projects` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:34.345808 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f5d99-95b8-47a4-bde2-6eef52c81980 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:34.346114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f5d99-95b8-47a4-bde2-6eef52c81980 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:34.347558 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f5d99-95b8-47a4-bde2-6eef52c81980 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:34.359023 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 429/852] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:28:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:34.365220 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568f5bc-d0ba-4434-b1f7-149dfa43b9ea None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:34.426590 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:34.464915 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568f5bc-d0ba-4434-b1f7-149dfa43b9ea None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:34.504234 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460e9d1-0be5-49e6-b4f7-1a3eb7ea7231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:34.504891 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460e9d1-0be5-49e6-b4f7-1a3eb7ea7231 None admin] REQUEST_METHOD: `PUT` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:34.505172 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460e9d1-0be5-49e6-b4f7-1a3eb7ea7231 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:34.505443 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460e9d1-0be5-49e6-b4f7-1a3eb7ea7231 None admin] PATH_INFO: `/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/eef56a81a66744b2a3e468b7f182f9ef/roles/2d13d41360794cff9c85249999f92061` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:34.519767 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460e9d1-0be5-49e6-b4f7-1a3eb7ea7231 None admin] RBAC: Authorizing `identity:create_grant(project_id=947f199ed73148beb3a4ecbc82cded19, user_id=eef56a81a66744b2a3e468b7f182f9ef, role_id=2d13d41360794cff9c85249999f92061)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:34.521486 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460e9d1-0be5-49e6-b4f7-1a3eb7ea7231 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:34.644667 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 424/853] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:28:34 2022] PUT /identity/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/eef56a81a66744b2a3e468b7f182f9ef/roles/2d13d41360794cff9c85249999f92061 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:28:36.799435 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f420ac2-38d3-45b2-a496-a37d20d14c3e None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:36.799950 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f420ac2-38d3-45b2-a496-a37d20d14c3e None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:36.800042 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f420ac2-38d3-45b2-a496-a37d20d14c3e None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:36.801308 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 430/854] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:36.806481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9e7b6-87cb-4234-916c-359a537205fb None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:36.806874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9e7b6-87cb-4234-916c-359a537205fb None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:36.807021 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9e7b6-87cb-4234-916c-359a537205fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:36.825574 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-3ef9e7b6-87cb-4234-916c-359a537205fb None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:36.826801 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-3ef9e7b6-87cb-4234-916c-359a537205fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:36.893775 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 425/855] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:28:36 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:28:37.219885 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f420ac2-38d3-45b2-a496-a37d20d14c3e None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:37.245761 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:37.325873 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f420ac2-38d3-45b2-a496-a37d20d14c3e None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:37.359325 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c0e93-51bc-4998-96e7-62a59b1f0b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:37.359939 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c0e93-51bc-4998-96e7-62a59b1f0b63 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:37.360217 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c0e93-51bc-4998-96e7-62a59b1f0b63 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:37.360491 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c0e93-51bc-4998-96e7-62a59b1f0b63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:37.370438 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c0e93-51bc-4998-96e7-62a59b1f0b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-540c0e93-51bc-4998-96e7-62a59b1f0b63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:28:37.375665 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:37.376773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:37.378059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:37.378059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:37.378059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:37.378059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:37.378059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:28:37.378059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:28:37.378059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:28:37.378059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:28:37.378059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:28:37.378059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:28:37.378059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:28:37.378059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:37.378059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 431/856] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Aug 23 16:28:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:37.382876 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9e7b6-87cb-4234-916c-359a537205fb None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:37.425310 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:37.479732 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9e7b6-87cb-4234-916c-359a537205fb None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:37.513450 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc8846-c4a6-42bc-bad7-e66df9bfbef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:37.514046 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc8846-c4a6-42bc-bad7-e66df9bfbef6 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:37.514486 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc8846-c4a6-42bc-bad7-e66df9bfbef6 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:37.514760 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc8846-c4a6-42bc-bad7-e66df9bfbef6 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:37.515450 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc8846-c4a6-42bc-bad7-e66df9bfbef6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:37.515753 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc8846-c4a6-42bc-bad7-e66df9bfbef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:37.517108 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc8846-c4a6-42bc-bad7-e66df9bfbef6 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:37.525207 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 426/857] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Aug 23 16:28:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:37.531115 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c0e93-51bc-4998-96e7-62a59b1f0b63 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:37.616460 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:37.632228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c0e93-51bc-4998-96e7-62a59b1f0b63 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:37.665625 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bd57d-11a0-4c13-aafd-4da542fa2ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:37.666240 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bd57d-11a0-4c13-aafd-4da542fa2ff7 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:37.666519 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bd57d-11a0-4c13-aafd-4da542fa2ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:37.666793 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bd57d-11a0-4c13-aafd-4da542fa2ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:37.676924 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bd57d-11a0-4c13-aafd-4da542fa2ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:37.678353 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bd57d-11a0-4c13-aafd-4da542fa2ff7 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-c38bd57d-11a0-4c13-aafd-4da542fa2ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:28:37.692973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:37.694087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:28:37.695012 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:28:37.695012 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:37.695012 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:37.695012 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 432/858] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:37.700030 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc8846-c4a6-42bc-bad7-e66df9bfbef6 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:37.798165 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc8846-c4a6-42bc-bad7-e66df9bfbef6 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:37.800526 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:37.831164 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1b92f-3971-4959-87d9-22057281ec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:37.831816 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1b92f-3971-4959-87d9-22057281ec6a None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:37.832082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1b92f-3971-4959-87d9-22057281ec6a None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:37.832352 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1b92f-3971-4959-87d9-22057281ec6a None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:37.832979 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1b92f-3971-4959-87d9-22057281ec6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:37.833280 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1b92f-3971-4959-87d9-22057281ec6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:37.834627 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1b92f-3971-4959-87d9-22057281ec6a None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:37.845841 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 427/859] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:37.851814 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bd57d-11a0-4c13-aafd-4da542fa2ff7 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:37.960793 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bd57d-11a0-4c13-aafd-4da542fa2ff7 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:37.995460 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733e774-27b7-4222-8934-34d174dd2fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:37.996082 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733e774-27b7-4222-8934-34d174dd2fb8 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:37.996355 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733e774-27b7-4222-8934-34d174dd2fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:37.996622 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733e774-27b7-4222-8934-34d174dd2fb8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:37.999401 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:38.004880 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733e774-27b7-4222-8934-34d174dd2fb8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:38.006316 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733e774-27b7-4222-8934-34d174dd2fb8 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-e733e774-27b7-4222-8934-34d174dd2fb8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:28:38.017191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:38.022116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:38.023062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:38.023062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:38.023062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:28:38.023062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:28:38.023062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:28:38.023062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:28:38.023062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:28:38.023062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:28:38.023062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:28:38.023062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:38.023062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 433/860] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:38.024756 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1b92f-3971-4959-87d9-22057281ec6a None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:38.126669 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1b92f-3971-4959-87d9-22057281ec6a None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:38.161223 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4b700-269f-4eea-abc3-8c7fa29b43aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:38.161829 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4b700-269f-4eea-abc3-8c7fa29b43aa None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:38.162107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4b700-269f-4eea-abc3-8c7fa29b43aa None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:38.162502 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4b700-269f-4eea-abc3-8c7fa29b43aa None admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:38.163139 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4b700-269f-4eea-abc3-8c7fa29b43aa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:38.163482 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4b700-269f-4eea-abc3-8c7fa29b43aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:38.164912 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4b700-269f-4eea-abc3-8c7fa29b43aa None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:38.182543 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 428/861] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Aug 23 16:28:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:38.188533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733e774-27b7-4222-8934-34d174dd2fb8 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:38.292872 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733e774-27b7-4222-8934-34d174dd2fb8 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:38.328496 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bb0b5-cbc3-4969-822d-5287fc11af71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:38.329103 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bb0b5-cbc3-4969-822d-5287fc11af71 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:38.329385 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bb0b5-cbc3-4969-822d-5287fc11af71 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:38.329658 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bb0b5-cbc3-4969-822d-5287fc11af71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:38.388945 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:38.395531 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bb0b5-cbc3-4969-822d-5287fc11af71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:38.397298 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bb0b5-cbc3-4969-822d-5287fc11af71 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:38.489438 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 434/862] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:28:38 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:28:38.495614 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4b700-269f-4eea-abc3-8c7fa29b43aa None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:38.519942 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:38.594602 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4b700-269f-4eea-abc3-8c7fa29b43aa None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:38.627897 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8aa7d2-253c-4a95-8d25-d9e5d7d95d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:38.628534 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8aa7d2-253c-4a95-8d25-d9e5d7d95d0f None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:38.628810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8aa7d2-253c-4a95-8d25-d9e5d7d95d0f None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:38.629081 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8aa7d2-253c-4a95-8d25-d9e5d7d95d0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:38.640081 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8aa7d2-253c-4a95-8d25-d9e5d7d95d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:38.641527 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8aa7d2-253c-4a95-8d25-d9e5d7d95d0f None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-ed8aa7d2-253c-4a95-8d25-d9e5d7d95d0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:28:38.661682 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:38.662672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:28:38.663589 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:28:38.663589 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:38.663589 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:38.663589 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 429/863] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:38.669302 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bb0b5-cbc3-4969-822d-5287fc11af71 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:38.760755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:38.766431 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bb0b5-cbc3-4969-822d-5287fc11af71 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:38.800207 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a39f9d-09b2-4d2a-b37f-35902eb6399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:38.800799 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39f9d-09b2-4d2a-b37f-35902eb6399c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:38.801075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39f9d-09b2-4d2a-b37f-35902eb6399c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:38.801342 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39f9d-09b2-4d2a-b37f-35902eb6399c None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:38.801966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a39f9d-09b2-4d2a-b37f-35902eb6399c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:38.802264 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a39f9d-09b2-4d2a-b37f-35902eb6399c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:38.803787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a39f9d-09b2-4d2a-b37f-35902eb6399c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:38.814502 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 435/864] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:38.820155 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8aa7d2-253c-4a95-8d25-d9e5d7d95d0f None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:38.893822 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:38.918186 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8aa7d2-253c-4a95-8d25-d9e5d7d95d0f None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:38.950740 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1502ca-d16a-4e95-8f6f-971366ed08c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:38.951446 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1502ca-d16a-4e95-8f6f-971366ed08c0 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:38.951750 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1502ca-d16a-4e95-8f6f-971366ed08c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:38.952020 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1502ca-d16a-4e95-8f6f-971366ed08c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:38.959278 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1502ca-d16a-4e95-8f6f-971366ed08c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:38.960730 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1502ca-d16a-4e95-8f6f-971366ed08c0 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-df1502ca-d16a-4e95-8f6f-971366ed08c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:28:38.972452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:38.979516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:38.980616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:28:38.980616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:28:38.980616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:28:38.980616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:28:38.980616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:28:38.980616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:28:38.980616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:28:38.980616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:38.980616 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 430/865] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:38.981201 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a39f9d-09b2-4d2a-b37f-35902eb6399c None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:39.080173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a39f9d-09b2-4d2a-b37f-35902eb6399c None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:39.112766 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16329423-6d64-4832-abd2-337c3243129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:39.113373 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16329423-6d64-4832-abd2-337c3243129c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:39.113663 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16329423-6d64-4832-abd2-337c3243129c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:39.113921 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16329423-6d64-4832-abd2-337c3243129c None admin] PATH_INFO: `/v3/projects` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:39.114676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16329423-6d64-4832-abd2-337c3243129c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:39.114909 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16329423-6d64-4832-abd2-337c3243129c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:39.116363 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16329423-6d64-4832-abd2-337c3243129c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:39.128071 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 436/866] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:28:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:39.134296 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1502ca-d16a-4e95-8f6f-971366ed08c0 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:39.234563 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1502ca-d16a-4e95-8f6f-971366ed08c0 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:39.268550 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651f2ef-332b-479b-ab63-13f1096ffaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:39.269050 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651f2ef-332b-479b-ab63-13f1096ffaa8 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:39.269324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651f2ef-332b-479b-ab63-13f1096ffaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:39.269600 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651f2ef-332b-479b-ab63-13f1096ffaa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:39.271072 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651f2ef-332b-479b-ab63-13f1096ffaa8 None admin] RBAC: Adding query filter params (role.id=2d13d41360794cff9c85249999f92061, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=eef56a81a66744b2a3e468b7f182f9ef) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:39.271072 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651f2ef-332b-479b-ab63-13f1096ffaa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:39.272291 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651f2ef-332b-479b-ab63-13f1096ffaa8 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:39.274125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:39.278437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 431/867] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:28:39 2022] GET /identity/v3/role_assignments?user.id=eef56a81a66744b2a3e468b7f182f9ef&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=2d13d41360794cff9c85249999f92061 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:41.513699 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a73ce9-a905-44a4-ac26-85daa63a8f02 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:41.514799 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a73ce9-a905-44a4-ac26-85daa63a8f02 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:41.514924 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a73ce9-a905-44a4-ac26-85daa63a8f02 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:41.516182 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 437/868] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:41.521571 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90da57-aba6-421b-b333-b44ffe11f255 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:41.522087 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90da57-aba6-421b-b333-b44ffe11f255 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:41.522172 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90da57-aba6-421b-b333-b44ffe11f255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:41.540486 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-9c90da57-aba6-421b-b333-b44ffe11f255 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:41.541677 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-9c90da57-aba6-421b-b333-b44ffe11f255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:41.606514 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 432/869] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:28:41 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:28:41.933210 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a73ce9-a905-44a4-ac26-85daa63a8f02 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:41.951426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:42.033196 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a73ce9-a905-44a4-ac26-85daa63a8f02 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:42.066561 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411a234-e97d-4a38-ade1-d51d97882ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:42.067178 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a234-e97d-4a38-ade1-d51d97882ee4 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:42.067485 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a234-e97d-4a38-ade1-d51d97882ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:42.067749 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a234-e97d-4a38-ade1-d51d97882ee4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:42.077972 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411a234-e97d-4a38-ade1-d51d97882ee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-9411a234-e97d-4a38-ade1-d51d97882ee4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:28:42.082693 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:42.083879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:42.084883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:42.084883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:42.084883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:42.084883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:42.084883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:28:42.084883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:28:42.084883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:28:42.084883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:28:42.084883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:28:42.084883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:28:42.084883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:28:42.084883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:42.084883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 438/870] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:42.089843 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90da57-aba6-421b-b333-b44ffe11f255 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:42.185103 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90da57-aba6-421b-b333-b44ffe11f255 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:42.211836 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:42.219170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30139c50-bf4c-483f-af28-19a46a408331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:42.219819 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30139c50-bf4c-483f-af28-19a46a408331 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:42.220093 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30139c50-bf4c-483f-af28-19a46a408331 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:42.220361 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30139c50-bf4c-483f-af28-19a46a408331 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:42.221004 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30139c50-bf4c-483f-af28-19a46a408331 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:42.221304 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30139c50-bf4c-483f-af28-19a46a408331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:42.222657 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30139c50-bf4c-483f-af28-19a46a408331 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:42.230348 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 433/871] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:28:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:28:42.236731 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411a234-e97d-4a38-ade1-d51d97882ee4 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:42.312895 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:42.336746 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411a234-e97d-4a38-ade1-d51d97882ee4 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:42.369241 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31455afb-88b3-4d36-819b-ece437e5537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:42.369946 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31455afb-88b3-4d36-819b-ece437e5537d None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:42.370194 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31455afb-88b3-4d36-819b-ece437e5537d None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:42.370471 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31455afb-88b3-4d36-819b-ece437e5537d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:42.381342 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31455afb-88b3-4d36-819b-ece437e5537d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:42.382785 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31455afb-88b3-4d36-819b-ece437e5537d None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-31455afb-88b3-4d36-819b-ece437e5537d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:28:42.396604 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:42.397700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:28:42.398628 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:28:42.398628 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:42.398628 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:42.398628 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 439/872] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:42.403681 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30139c50-bf4c-483f-af28-19a46a408331 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:42.502209 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30139c50-bf4c-483f-af28-19a46a408331 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:42.535654 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144efddd-bece-4ce5-ba36-b7a507b3e572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:42.536304 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144efddd-bece-4ce5-ba36-b7a507b3e572 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:42.536518 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144efddd-bece-4ce5-ba36-b7a507b3e572 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:42.536792 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144efddd-bece-4ce5-ba36-b7a507b3e572 None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:42.537456 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144efddd-bece-4ce5-ba36-b7a507b3e572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:42.537761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144efddd-bece-4ce5-ba36-b7a507b3e572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:42.539148 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144efddd-bece-4ce5-ba36-b7a507b3e572 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:42.551204 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 434/873] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:42.557077 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31455afb-88b3-4d36-819b-ece437e5537d None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:42.657426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31455afb-88b3-4d36-819b-ece437e5537d None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:42.682126 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:42.690175 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327cc73-a333-4788-a0d9-6089a13fa4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:42.690787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327cc73-a333-4788-a0d9-6089a13fa4f0 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:42.691062 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327cc73-a333-4788-a0d9-6089a13fa4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:42.691359 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327cc73-a333-4788-a0d9-6089a13fa4f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:42.698507 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327cc73-a333-4788-a0d9-6089a13fa4f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:42.699953 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327cc73-a333-4788-a0d9-6089a13fa4f0 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-d327cc73-a333-4788-a0d9-6089a13fa4f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:28:42.711144 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:42.712091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:42.713097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:42.713097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:42.713097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:28:42.713097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:28:42.713097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:28:42.713097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:28:42.713097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:28:42.713097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:28:42.713097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:28:42.713097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:42.713097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 440/874] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:42.718906 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144efddd-bece-4ce5-ba36-b7a507b3e572 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:42.769891 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:42.818014 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144efddd-bece-4ce5-ba36-b7a507b3e572 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:42.849906 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06724c-d848-41af-8ed7-6f312ef054c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:42.850505 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06724c-d848-41af-8ed7-6f312ef054c9 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:42.850780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06724c-d848-41af-8ed7-6f312ef054c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:42.851055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06724c-d848-41af-8ed7-6f312ef054c9 None admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:42.851956 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06724c-d848-41af-8ed7-6f312ef054c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:42.852262 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06724c-d848-41af-8ed7-6f312ef054c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:42.853677 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06724c-d848-41af-8ed7-6f312ef054c9 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:42.870480 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 435/875] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Aug 23 16:28:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:42.876961 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327cc73-a333-4788-a0d9-6089a13fa4f0 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:42.977466 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327cc73-a333-4788-a0d9-6089a13fa4f0 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:43.010982 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3116dc-4a87-4135-b4c4-c3fd6fae1dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:43.011606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3116dc-4a87-4135-b4c4-c3fd6fae1dbc None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:43.011915 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3116dc-4a87-4135-b4c4-c3fd6fae1dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:43.017728 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3116dc-4a87-4135-b4c4-c3fd6fae1dbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:43.065678 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:43.078644 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3116dc-4a87-4135-b4c4-c3fd6fae1dbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:43.080212 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3116dc-4a87-4135-b4c4-c3fd6fae1dbc None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:43.175473 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 441/876] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:28:42 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:28:43.181279 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06724c-d848-41af-8ed7-6f312ef054c9 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:43.279511 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06724c-d848-41af-8ed7-6f312ef054c9 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:43.289126 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:43.316379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98f959-9f6c-4c5d-9db4-bf7c8d614578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:43.316601 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98f959-9f6c-4c5d-9db4-bf7c8d614578 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:43.316898 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98f959-9f6c-4c5d-9db4-bf7c8d614578 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:43.317214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98f959-9f6c-4c5d-9db4-bf7c8d614578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:43.329261 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98f959-9f6c-4c5d-9db4-bf7c8d614578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:43.331091 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98f959-9f6c-4c5d-9db4-bf7c8d614578 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-2f98f959-9f6c-4c5d-9db4-bf7c8d614578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:28:43.346874 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:43.348123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:28:43.349326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:28:43.349326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:43.349326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:43.349326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 436/877] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:43.353883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3116dc-4a87-4135-b4c4-c3fd6fae1dbc None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:43.440165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:43.451694 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3116dc-4a87-4135-b4c4-c3fd6fae1dbc None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:43.485222 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bd881-930b-4f56-a6c4-25e75acda809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:43.485834 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bd881-930b-4f56-a6c4-25e75acda809 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:43.486114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bd881-930b-4f56-a6c4-25e75acda809 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:43.486390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bd881-930b-4f56-a6c4-25e75acda809 None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:43.487031 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bd881-930b-4f56-a6c4-25e75acda809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:43.487377 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bd881-930b-4f56-a6c4-25e75acda809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:43.488740 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bd881-930b-4f56-a6c4-25e75acda809 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:43.499824 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 442/878] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:43.505537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98f959-9f6c-4c5d-9db4-bf7c8d614578 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:43.605455 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98f959-9f6c-4c5d-9db4-bf7c8d614578 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:43.639242 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aafd6-e827-44d0-bbf0-b42365369cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:43.639882 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aafd6-e827-44d0-bbf0-b42365369cf4 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:43.640164 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aafd6-e827-44d0-bbf0-b42365369cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:43.640444 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aafd6-e827-44d0-bbf0-b42365369cf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:43.647294 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9aafd6-e827-44d0-bbf0-b42365369cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:43.648956 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9aafd6-e827-44d0-bbf0-b42365369cf4 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-1a9aafd6-e827-44d0-bbf0-b42365369cf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:28:43.660171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:43.661230 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:43.662177 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:28:43.662177 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:28:43.662177 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:28:43.662177 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:28:43.662177 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:28:43.662177 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:28:43.662177 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:28:43.662177 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:43.662177 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 437/879] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:28:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:43.667482 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bd881-930b-4f56-a6c4-25e75acda809 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:43.765137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bd881-930b-4f56-a6c4-25e75acda809 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:43.798112 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd197e8-2511-47fa-aa49-68406015ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:43.798710 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd197e8-2511-47fa-aa49-68406015ec59 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:43.798985 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd197e8-2511-47fa-aa49-68406015ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:43.799279 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd197e8-2511-47fa-aa49-68406015ec59 None admin] PATH_INFO: `/v3/projects` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:43.799957 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd197e8-2511-47fa-aa49-68406015ec59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:43.800261 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd197e8-2511-47fa-aa49-68406015ec59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:43.801666 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd197e8-2511-47fa-aa49-68406015ec59 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:43.813995 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 443/880] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:43.820270 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aafd6-e827-44d0-bbf0-b42365369cf4 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:43.843039 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:43.919365 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aafd6-e827-44d0-bbf0-b42365369cf4 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:43.952850 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe99f8-67c6-4b00-86f6-6c35c9816689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:43.953437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe99f8-67c6-4b00-86f6-6c35c9816689 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:43.953714 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe99f8-67c6-4b00-86f6-6c35c9816689 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:43.953980 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe99f8-67c6-4b00-86f6-6c35c9816689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:43.954687 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe99f8-67c6-4b00-86f6-6c35c9816689 None admin] RBAC: Adding query filter params (role.id=091802a86e334e129210219b7c69359d, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=eef56a81a66744b2a3e468b7f182f9ef) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:43.954990 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe99f8-67c6-4b00-86f6-6c35c9816689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:43.956438 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe99f8-67c6-4b00-86f6-6c35c9816689 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:43.961624 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 438/881] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:28:43 2022] GET /identity/v3/role_assignments?user.id=eef56a81a66744b2a3e468b7f182f9ef&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=091802a86e334e129210219b7c69359d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:46.105350 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59343b76-1cd8-4d4e-8677-472b8e7c4f40 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:46.105877 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59343b76-1cd8-4d4e-8677-472b8e7c4f40 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:46.105877 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59343b76-1cd8-4d4e-8677-472b8e7c4f40 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:46.107242 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 444/882] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:46.112872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029b463-25a3-4ee8-a82a-04490d53dc9a None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:46.113314 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029b463-25a3-4ee8-a82a-04490d53dc9a None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:46.113482 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029b463-25a3-4ee8-a82a-04490d53dc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:46.132192 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-7029b463-25a3-4ee8-a82a-04490d53dc9a None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:46.133308 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-7029b463-25a3-4ee8-a82a-04490d53dc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:46.198772 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 439/883] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:28:46 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:28:46.525690 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59343b76-1cd8-4d4e-8677-472b8e7c4f40 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:46.536762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:46.627385 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59343b76-1cd8-4d4e-8677-472b8e7c4f40 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:46.663986 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44437ad1-6c13-48da-b189-7e421bb20544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:46.664603 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44437ad1-6c13-48da-b189-7e421bb20544 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:46.664874 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44437ad1-6c13-48da-b189-7e421bb20544 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:46.665141 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44437ad1-6c13-48da-b189-7e421bb20544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:46.675478 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44437ad1-6c13-48da-b189-7e421bb20544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-44437ad1-6c13-48da-b189-7e421bb20544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:28:46.680164 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:46.681168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:46.682021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:46.682021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:46.682021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:46.682021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:46.682021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:28:46.682021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:28:46.682021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:28:46.682021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:28:46.682021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:28:46.682021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:28:46.682021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:28:46.682021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:46.682021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 445/884] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:28:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:46.688049 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029b463-25a3-4ee8-a82a-04490d53dc9a None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:46.702678 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:46.787053 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029b463-25a3-4ee8-a82a-04490d53dc9a None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:46.821294 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83f663-2a1b-41a3-8d12-229717d50ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:46.821896 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83f663-2a1b-41a3-8d12-229717d50ca6 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:46.822170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83f663-2a1b-41a3-8d12-229717d50ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:46.822436 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83f663-2a1b-41a3-8d12-229717d50ca6 None admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:46.823082 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83f663-2a1b-41a3-8d12-229717d50ca6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:46.823482 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83f663-2a1b-41a3-8d12-229717d50ca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:46.824830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83f663-2a1b-41a3-8d12-229717d50ca6 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:46.832845 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 440/885] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:28:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:46.838537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44437ad1-6c13-48da-b189-7e421bb20544 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:46.905465 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:46.937715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44437ad1-6c13-48da-b189-7e421bb20544 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:46.970554 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5fca4-ade5-4a30-8082-a0b97516583a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:46.971290 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5fca4-ade5-4a30-8082-a0b97516583a None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:46.971576 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5fca4-ade5-4a30-8082-a0b97516583a None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:46.971849 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5fca4-ade5-4a30-8082-a0b97516583a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:46.981839 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5fca4-ade5-4a30-8082-a0b97516583a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:46.983953 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5fca4-ade5-4a30-8082-a0b97516583a None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-eba5fca4-ade5-4a30-8082-a0b97516583a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:28:46.998391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:46.999553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:28:47.000484 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:28:47.000484 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:47.000484 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:47.000484 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 446/886] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:47.005372 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83f663-2a1b-41a3-8d12-229717d50ca6 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:47.082753 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:47.105321 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83f663-2a1b-41a3-8d12-229717d50ca6 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:47.138015 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee59900-ed7d-4517-aeb8-f32c764aed8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:47.138635 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee59900-ed7d-4517-aeb8-f32c764aed8b None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:47.138879 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee59900-ed7d-4517-aeb8-f32c764aed8b None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:47.139250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee59900-ed7d-4517-aeb8-f32c764aed8b None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:47.139939 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee59900-ed7d-4517-aeb8-f32c764aed8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:47.140244 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee59900-ed7d-4517-aeb8-f32c764aed8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:47.141623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee59900-ed7d-4517-aeb8-f32c764aed8b None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:47.153888 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 441/887] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:47.160182 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5fca4-ade5-4a30-8082-a0b97516583a None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:47.259997 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5fca4-ade5-4a30-8082-a0b97516583a None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:47.280385 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:47.293886 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bb5c4-b479-487e-9308-f86229e67092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:47.294508 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bb5c4-b479-487e-9308-f86229e67092 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:47.294787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bb5c4-b479-487e-9308-f86229e67092 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:47.295059 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bb5c4-b479-487e-9308-f86229e67092 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:47.302299 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bb5c4-b479-487e-9308-f86229e67092 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:47.303792 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bb5c4-b479-487e-9308-f86229e67092 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-028bb5c4-b479-487e-9308-f86229e67092 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:28:47.314533 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:47.315671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:47.316817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:47.316817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:47.316817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:28:47.316817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:28:47.316817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:28:47.316817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:28:47.316817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:28:47.316817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:28:47.316817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:28:47.316817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:47.316817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 447/888] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:47.321564 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee59900-ed7d-4517-aeb8-f32c764aed8b None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:47.426648 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee59900-ed7d-4517-aeb8-f32c764aed8b None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:47.459993 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d4bc-9619-4c38-b2fc-b29bafd5b3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:47.460590 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d4bc-9619-4c38-b2fc-b29bafd5b3a7 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:47.460868 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d4bc-9619-4c38-b2fc-b29bafd5b3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:47.461136 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d4bc-9619-4c38-b2fc-b29bafd5b3a7 None admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:47.461854 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677d4bc-9619-4c38-b2fc-b29bafd5b3a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:47.462157 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677d4bc-9619-4c38-b2fc-b29bafd5b3a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:47.469930 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677d4bc-9619-4c38-b2fc-b29bafd5b3a7 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:47.469930 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:47.481815 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 442/889] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Aug 23 16:28:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:47.487801 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bb5c4-b479-487e-9308-f86229e67092 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:47.587639 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bb5c4-b479-487e-9308-f86229e67092 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:47.620384 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb231ea-471e-4365-bfec-924ab8f2a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:47.621046 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb231ea-471e-4365-bfec-924ab8f2a66b None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:47.621325 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb231ea-471e-4365-bfec-924ab8f2a66b None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:47.621635 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb231ea-471e-4365-bfec-924ab8f2a66b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:47.632438 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb231ea-471e-4365-bfec-924ab8f2a66b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:47.633854 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb231ea-471e-4365-bfec-924ab8f2a66b None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-fdb231ea-471e-4365-bfec-924ab8f2a66b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:28:47.648642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:47.649651 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:28:47.650899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:28:47.650899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:47.650899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:47.650899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 448/890] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:47.655686 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d4bc-9619-4c38-b2fc-b29bafd5b3a7 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:47.753237 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d4bc-9619-4c38-b2fc-b29bafd5b3a7 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:47.791262 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010a0a0-cb56-4115-ba10-14965def0a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:47.791894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010a0a0-cb56-4115-ba10-14965def0a7f None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:47.792170 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010a0a0-cb56-4115-ba10-14965def0a7f None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:47.792440 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010a0a0-cb56-4115-ba10-14965def0a7f None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:47.793168 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010a0a0-cb56-4115-ba10-14965def0a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:47.793520 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010a0a0-cb56-4115-ba10-14965def0a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:47.795503 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010a0a0-cb56-4115-ba10-14965def0a7f None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:47.807028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 443/891] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:47.813537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb231ea-471e-4365-bfec-924ab8f2a66b None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:47.845537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:47.911129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb231ea-471e-4365-bfec-924ab8f2a66b None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:47.943459 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f5a6e-9290-48a0-88e3-18707edc1b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:47.944074 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f5a6e-9290-48a0-88e3-18707edc1b45 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:47.944354 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f5a6e-9290-48a0-88e3-18707edc1b45 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:47.944630 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f5a6e-9290-48a0-88e3-18707edc1b45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:47.951123 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f5a6e-9290-48a0-88e3-18707edc1b45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:47.952591 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f5a6e-9290-48a0-88e3-18707edc1b45 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-235f5a6e-9290-48a0-88e3-18707edc1b45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:28:47.963736 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:47.965543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:47.966427 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:28:47.966427 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:28:47.966427 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:28:47.966427 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:28:47.966427 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:28:47.966427 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:28:47.966427 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:28:47.966427 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:47.966427 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 449/892] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:28:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:47.971434 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010a0a0-cb56-4115-ba10-14965def0a7f None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:48.037511 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:48.069609 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010a0a0-cb56-4115-ba10-14965def0a7f None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:48.106348 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f828a54-fddc-42f4-8856-eaeebca4f61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:48.106956 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f828a54-fddc-42f4-8856-eaeebca4f61f None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:48.107259 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f828a54-fddc-42f4-8856-eaeebca4f61f None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:48.107534 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f828a54-fddc-42f4-8856-eaeebca4f61f None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:48.108243 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f828a54-fddc-42f4-8856-eaeebca4f61f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:48.108548 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f828a54-fddc-42f4-8856-eaeebca4f61f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:48.109970 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f828a54-fddc-42f4-8856-eaeebca4f61f None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:48.121527 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 444/893] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:48.127727 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f5a6e-9290-48a0-88e3-18707edc1b45 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:48.219585 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:48.227840 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f5a6e-9290-48a0-88e3-18707edc1b45 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:48.260457 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5523bbc-9412-48a8-b2db-b8cdc1394c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:48.261099 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5523bbc-9412-48a8-b2db-b8cdc1394c32 None admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:48.261376 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5523bbc-9412-48a8-b2db-b8cdc1394c32 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:48.261645 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5523bbc-9412-48a8-b2db-b8cdc1394c32 None admin] PATH_INFO: `/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/eef56a81a66744b2a3e468b7f182f9ef/roles/091802a86e334e129210219b7c69359d` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:48.263522 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5523bbc-9412-48a8-b2db-b8cdc1394c32 None admin] RBAC: Authorizing `identity:create_grant(project_id=947f199ed73148beb3a4ecbc82cded19, user_id=eef56a81a66744b2a3e468b7f182f9ef, role_id=091802a86e334e129210219b7c69359d)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:48.264954 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5523bbc-9412-48a8-b2db-b8cdc1394c32 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:48.421734 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 450/894] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Aug 23 16:28:48 2022] PUT /identity/v3/projects/947f199ed73148beb3a4ecbc82cded19/users/eef56a81a66744b2a3e468b7f182f9ef/roles/091802a86e334e129210219b7c69359d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:28:50.583571 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c09633-d17d-441b-a335-0ad7994015d3 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:50.584132 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c09633-d17d-441b-a335-0ad7994015d3 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:50.584132 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c09633-d17d-441b-a335-0ad7994015d3 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:50.585432 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 445/895] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:50.590645 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639dc1e-6a23-4c5d-b834-2d348e31dda1 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:50.591089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639dc1e-6a23-4c5d-b834-2d348e31dda1 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:50.591177 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639dc1e-6a23-4c5d-b834-2d348e31dda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:50.610153 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-f639dc1e-6a23-4c5d-b834-2d348e31dda1 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:50.611405 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-f639dc1e-6a23-4c5d-b834-2d348e31dda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:50.681776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 451/896] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:28:50 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:28:51.009818 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c09633-d17d-441b-a335-0ad7994015d3 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:51.111793 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c09633-d17d-441b-a335-0ad7994015d3 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:51.127037 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:51.146137 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e5a4a-c6f9-40ce-b493-aafd9c81a9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:51.147013 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e5a4a-c6f9-40ce-b493-aafd9c81a9f7 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:51.147323 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e5a4a-c6f9-40ce-b493-aafd9c81a9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:51.147598 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e5a4a-c6f9-40ce-b493-aafd9c81a9f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:51.157744 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e5a4a-c6f9-40ce-b493-aafd9c81a9f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-af4e5a4a-c6f9-40ce-b493-aafd9c81a9f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:28:51.162445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:51.163449 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:51.164384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:51.164384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:51.164384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:51.164384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:51.164384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:28:51.164384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:28:51.164384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:28:51.164384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:28:51.164384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:28:51.164384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:28:51.164384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:28:51.164384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:51.164384 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 446/897] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Aug 23 16:28:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:51.169711 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639dc1e-6a23-4c5d-b834-2d348e31dda1 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:51.250925 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:51.268609 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639dc1e-6a23-4c5d-b834-2d348e31dda1 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:51.301827 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f9509-f4c3-4afc-9ab7-e2cfc89a285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:51.302417 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f9509-f4c3-4afc-9ab7-e2cfc89a285f None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:51.302691 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f9509-f4c3-4afc-9ab7-e2cfc89a285f None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:51.302960 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f9509-f4c3-4afc-9ab7-e2cfc89a285f None admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:51.303709 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f9509-f4c3-4afc-9ab7-e2cfc89a285f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:51.304010 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f9509-f4c3-4afc-9ab7-e2cfc89a285f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:51.305487 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f9509-f4c3-4afc-9ab7-e2cfc89a285f None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:51.314712 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 452/898] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Aug 23 16:28:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:51.320649 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e5a4a-c6f9-40ce-b493-aafd9c81a9f7 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:51.421202 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e5a4a-c6f9-40ce-b493-aafd9c81a9f7 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:51.459296 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32e27a-33f2-40e1-be16-0adab536c821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:51.459929 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32e27a-33f2-40e1-be16-0adab536c821 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:51.460204 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32e27a-33f2-40e1-be16-0adab536c821 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:51.460500 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32e27a-33f2-40e1-be16-0adab536c821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:51.471078 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32e27a-33f2-40e1-be16-0adab536c821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:51.472566 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32e27a-33f2-40e1-be16-0adab536c821 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-aa32e27a-33f2-40e1-be16-0adab536c821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:28:51.486745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:51.487957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:28:51.489088 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:28:51.489088 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:51.489088 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:51.489088 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 447/899] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:51.493675 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f9509-f4c3-4afc-9ab7-e2cfc89a285f None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:51.592364 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f9509-f4c3-4afc-9ab7-e2cfc89a285f None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:51.624769 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547ac91-8f37-435d-80c5-34afff63d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:51.625378 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547ac91-8f37-435d-80c5-34afff63d0ce None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:51.625638 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547ac91-8f37-435d-80c5-34afff63d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:51.625928 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547ac91-8f37-435d-80c5-34afff63d0ce None admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:51.626537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547ac91-8f37-435d-80c5-34afff63d0ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:51.626845 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547ac91-8f37-435d-80c5-34afff63d0ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:51.628231 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547ac91-8f37-435d-80c5-34afff63d0ce None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:51.640196 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 453/900] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:51.646036 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32e27a-33f2-40e1-be16-0adab536c821 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:51.674134 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:51.744110 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32e27a-33f2-40e1-be16-0adab536c821 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:51.778229 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbcbe3-05da-4bf3-8a1b-f689ebe45090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:51.778853 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbcbe3-05da-4bf3-8a1b-f689ebe45090 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:51.779124 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbcbe3-05da-4bf3-8a1b-f689ebe45090 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:51.779484 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbcbe3-05da-4bf3-8a1b-f689ebe45090 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:51.786910 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbcbe3-05da-4bf3-8a1b-f689ebe45090 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:51.788427 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbcbe3-05da-4bf3-8a1b-f689ebe45090 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-3afbcbe3-05da-4bf3-8a1b-f689ebe45090 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:28:51.799575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:51.800698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:51.801842 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:51.801842 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:51.801842 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:28:51.801842 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:28:51.801842 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:28:51.801842 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:28:51.801842 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:28:51.801842 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:28:51.801842 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:28:51.801842 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:51.801842 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 448/901] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:51.806491 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547ac91-8f37-435d-80c5-34afff63d0ce None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:51.810191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:51.905002 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547ac91-8f37-435d-80c5-34afff63d0ce None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:51.938436 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dd38d-dd26-4288-8431-031f0f54dd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:51.939035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dd38d-dd26-4288-8431-031f0f54dd6c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:51.939339 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dd38d-dd26-4288-8431-031f0f54dd6c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:51.939613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dd38d-dd26-4288-8431-031f0f54dd6c None admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:51.940325 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dd38d-dd26-4288-8431-031f0f54dd6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:51.940629 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dd38d-dd26-4288-8431-031f0f54dd6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:51.942046 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dd38d-dd26-4288-8431-031f0f54dd6c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:51.958675 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 454/902] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Aug 23 16:28:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:51.964597 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbcbe3-05da-4bf3-8a1b-f689ebe45090 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:52.054348 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:52.069822 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbcbe3-05da-4bf3-8a1b-f689ebe45090 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:52.101254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bcfc1-43e2-4279-94f8-d1dac68e46b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:52.101877 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bcfc1-43e2-4279-94f8-d1dac68e46b9 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:52.102153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bcfc1-43e2-4279-94f8-d1dac68e46b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:52.102422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bcfc1-43e2-4279-94f8-d1dac68e46b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:52.167266 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bcfc1-43e2-4279-94f8-d1dac68e46b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:52.168631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bcfc1-43e2-4279-94f8-d1dac68e46b9 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:52.249493 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:52.264158 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 449/903] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Aug 23 16:28:51 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:28:52.270489 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dd38d-dd26-4288-8431-031f0f54dd6c None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:52.331219 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:52.367787 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dd38d-dd26-4288-8431-031f0f54dd6c None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:52.400763 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0579fc-de35-477f-861f-d7a3181e9ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:52.402066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0579fc-de35-477f-861f-d7a3181e9ee2 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:52.402066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0579fc-de35-477f-861f-d7a3181e9ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:52.402066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0579fc-de35-477f-861f-d7a3181e9ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:52.412292 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0579fc-de35-477f-861f-d7a3181e9ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:52.413760 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0579fc-de35-477f-861f-d7a3181e9ee2 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-bf0579fc-de35-477f-861f-d7a3181e9ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:28:52.428228 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:52.433138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:28:52.434209 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:28:52.434209 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:28:52.434209 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:52.434209 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 455/904] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:52.435841 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bcfc1-43e2-4279-94f8-d1dac68e46b9 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:52.534169 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bcfc1-43e2-4279-94f8-d1dac68e46b9 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:52.566598 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e14a6c-b048-47de-b3e7-33de43ee5528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:52.567194 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e14a6c-b048-47de-b3e7-33de43ee5528 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:52.567500 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e14a6c-b048-47de-b3e7-33de43ee5528 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:52.567769 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e14a6c-b048-47de-b3e7-33de43ee5528 None admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:52.568398 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e14a6c-b048-47de-b3e7-33de43ee5528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:52.568698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e14a6c-b048-47de-b3e7-33de43ee5528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:52.570046 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e14a6c-b048-47de-b3e7-33de43ee5528 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:52.581459 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 450/905] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Aug 23 16:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:52.587238 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0579fc-de35-477f-861f-d7a3181e9ee2 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:52.686422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0579fc-de35-477f-861f-d7a3181e9ee2 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:52.699431 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:52.721920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1240f-f81e-4088-bb54-9680065dc657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:52.722552 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1240f-f81e-4088-bb54-9680065dc657 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:52.722832 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1240f-f81e-4088-bb54-9680065dc657 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:52.723103 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1240f-f81e-4088-bb54-9680065dc657 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:52.730478 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1240f-f81e-4088-bb54-9680065dc657 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:52.731986 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1240f-f81e-4088-bb54-9680065dc657 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application [None req-0fd1240f-f81e-4088-bb54-9680065dc657 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:28:52.747655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:52.748762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:52.749649 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:28:52.749649 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:28:52.749649 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:28:52.749649 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:28:52.749649 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:28:52.749649 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:28:52.749649 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:28:52.749649 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: ERROR keystone.server.flask.application Aug 23 16:28:52.749649 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 456/906] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Aug 23 16:28:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:52.754768 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e14a6c-b048-47de-b3e7-33de43ee5528 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:52.801714 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:52.852724 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e14a6c-b048-47de-b3e7-33de43ee5528 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:52.886183 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d469-5aca-4f27-a1ea-0d06a9d9cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:52.886776 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d469-5aca-4f27-a1ea-0d06a9d9cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:52.887050 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d469-5aca-4f27-a1ea-0d06a9d9cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:52.887353 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d469-5aca-4f27-a1ea-0d06a9d9cdc4 None admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:52.888058 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d469-5aca-4f27-a1ea-0d06a9d9cdc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:52.888359 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d469-5aca-4f27-a1ea-0d06a9d9cdc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:52.890372 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d469-5aca-4f27-a1ea-0d06a9d9cdc4 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:52.902974 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 451/907] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Aug 23 16:28:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:52.909330 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1240f-f81e-4088-bb54-9680065dc657 None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:53.017002 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1240f-f81e-4088-bb54-9680065dc657 None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:53.050762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205ae7-fff7-4863-bd33-45092dd99699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:53.051390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205ae7-fff7-4863-bd33-45092dd99699 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:53.051672 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205ae7-fff7-4863-bd33-45092dd99699 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:53.051945 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205ae7-fff7-4863-bd33-45092dd99699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:53.052656 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205ae7-fff7-4863-bd33-45092dd99699 None admin] RBAC: Adding query filter params (role.id=091802a86e334e129210219b7c69359d, scope.project.id=947f199ed73148beb3a4ecbc82cded19, user.id=eef56a81a66744b2a3e468b7f182f9ef) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:53.052962 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205ae7-fff7-4863-bd33-45092dd99699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:53.054379 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205ae7-fff7-4863-bd33-45092dd99699 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:53.059948 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 457/908] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Aug 23 16:28:52 2022] GET /identity/v3/role_assignments?user.id=eef56a81a66744b2a3e468b7f182f9ef&scope.project.id=947f199ed73148beb3a4ecbc82cded19&role.id=091802a86e334e129210219b7c69359d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:55.298823 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4b474-15f9-4ad3-85ab-d16c30bd31a3 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:55.299478 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4b474-15f9-4ad3-85ab-d16c30bd31a3 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:55.299478 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4b474-15f9-4ad3-85ab-d16c30bd31a3 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:55.300778 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 452/909] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:55.306244 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3581-63d8-4b59-bb3f-5c2905531db6 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:55.306662 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3581-63d8-4b59-bb3f-5c2905531db6 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:55.306775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3581-63d8-4b59-bb3f-5c2905531db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:55.324755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-e95f3581-63d8-4b59-bb3f-5c2905531db6 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:55.325942 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-e95f3581-63d8-4b59-bb3f-5c2905531db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:55.354848 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:55.391596 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 458/910] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:28:55 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:28:55.721445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4b474-15f9-4ad3-85ab-d16c30bd31a3 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:55.822680 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4b474-15f9-4ad3-85ab-d16c30bd31a3 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:55.830262 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:55.857553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e06d87-9d9e-4c1a-a261-18a7438cfadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:55.858176 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e06d87-9d9e-4c1a-a261-18a7438cfadb None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:55.858451 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e06d87-9d9e-4c1a-a261-18a7438cfadb None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:55.858720 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e06d87-9d9e-4c1a-a261-18a7438cfadb None admin] PATH_INFO: `/v3/services/placement` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:55.859318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e06d87-9d9e-4c1a-a261-18a7438cfadb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:55.860934 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e06d87-9d9e-4c1a-a261-18a7438cfadb None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-c6e06d87-9d9e-4c1a-a261-18a7438cfadb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:28:55.869810 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:28:55.871028 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:28:55.872069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 453/911] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Aug 23 16:28:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:28:55.877367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f3581-63d8-4b59-bb3f-5c2905531db6 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:55.975959 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f3581-63d8-4b59-bb3f-5c2905531db6 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:56.010548 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e2e3f-a5d1-43cf-974d-a0ce2c6909c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:56.011157 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e2e3f-a5d1-43cf-974d-a0ce2c6909c3 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:56.011459 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e2e3f-a5d1-43cf-974d-a0ce2c6909c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:56.011731 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e2e3f-a5d1-43cf-974d-a0ce2c6909c3 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:56.012357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e2e3f-a5d1-43cf-974d-a0ce2c6909c3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:56.012661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e2e3f-a5d1-43cf-974d-a0ce2c6909c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:56.014599 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e2e3f-a5d1-43cf-974d-a0ce2c6909c3 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:56.019363 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 459/912] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Aug 23 16:28:55 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:56.025695 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e06d87-9d9e-4c1a-a261-18a7438cfadb None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:56.124707 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e06d87-9d9e-4c1a-a261-18a7438cfadb None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:56.157926 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79e419-7082-4853-b19d-5610a09a7774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:56.158518 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79e419-7082-4853-b19d-5610a09a7774 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:56.158794 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79e419-7082-4853-b19d-5610a09a7774 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:56.159063 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79e419-7082-4853-b19d-5610a09a7774 None admin] PATH_INFO: `/v3/services` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:56.159711 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79e419-7082-4853-b19d-5610a09a7774 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:28:56.160012 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79e419-7082-4853-b19d-5610a09a7774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:56.161415 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79e419-7082-4853-b19d-5610a09a7774 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:56.165626 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 454/913] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Aug 23 16:28:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:28:58.368223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5c1e3-b869-40cd-ac44-e13e40a244f8 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:58.368755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5c1e3-b869-40cd-ac44-e13e40a244f8 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:58.368755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5c1e3-b869-40cd-ac44-e13e40a244f8 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:58.370090 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 460/914] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:58.375541 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1763bc-950e-4078-af04-2e2b50ffa0ca None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:58.375920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1763bc-950e-4078-af04-2e2b50ffa0ca None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:58.376080 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1763bc-950e-4078-af04-2e2b50ffa0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:58.394214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-0f1763bc-950e-4078-af04-2e2b50ffa0ca None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:58.395422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-0f1763bc-950e-4078-af04-2e2b50ffa0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:58.422870 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:58.461460 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 455/915] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:28:58 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:28:58.821048 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5c1e3-b869-40cd-ac44-e13e40a244f8 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:58.821048 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:58.888316 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5c1e3-b869-40cd-ac44-e13e40a244f8 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:58.922606 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1f17c-61c6-40cf-a1e0-0eddfd96f623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:58.923193 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1f17c-61c6-40cf-a1e0-0eddfd96f623 None admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:58.923500 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1f17c-61c6-40cf-a1e0-0eddfd96f623 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:58.923770 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1f17c-61c6-40cf-a1e0-0eddfd96f623 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:58.924400 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1f17c-61c6-40cf-a1e0-0eddfd96f623 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:58.925770 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1f17c-61c6-40cf-a1e0-0eddfd96f623 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:59.016441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 461/916] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Aug 23 16:28:58 2022] POST /identity/v3/services => generated 246 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:29:01.206366 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a26fa-7122-41c9-9519-b2ea1d1e41f6 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:01.206950 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a26fa-7122-41c9-9519-b2ea1d1e41f6 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:01.207071 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a26fa-7122-41c9-9519-b2ea1d1e41f6 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:01.208357 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 456/917] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:29:01.213487 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e5c8a-65b5-4f77-821d-8dbad5da5d05 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:01.215005 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e5c8a-65b5-4f77-821d-8dbad5da5d05 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:01.215005 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e5c8a-65b5-4f77-821d-8dbad5da5d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:01.243776 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-c37e5c8a-65b5-4f77-821d-8dbad5da5d05 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:29:01.244945 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-c37e5c8a-65b5-4f77-821d-8dbad5da5d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:01.316345 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 462/918] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:29:01 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:29:01.640578 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a26fa-7122-41c9-9519-b2ea1d1e41f6 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:01.740132 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a26fa-7122-41c9-9519-b2ea1d1e41f6 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:01.776975 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78ce89-c132-495e-94c3-969b6a22a148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:01.776975 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ce89-c132-495e-94c3-969b6a22a148 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:01.776975 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ce89-c132-495e-94c3-969b6a22a148 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:01.776975 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ce89-c132-495e-94c3-969b6a22a148 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:01.777367 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78ce89-c132-495e-94c3-969b6a22a148 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:01.778312 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78ce89-c132-495e-94c3-969b6a22a148 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-8e78ce89-c132-495e-94c3-969b6a22a148 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:29:01.787403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:29:01.788662 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:29:01.789605 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 457/919] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Aug 23 16:29:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:29:01.794579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e5c8a-65b5-4f77-821d-8dbad5da5d05 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:01.812387 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:01.890999 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e5c8a-65b5-4f77-821d-8dbad5da5d05 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:01.924020 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f810741-19e1-4f8b-a4cc-df4b283dda1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:01.924664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f810741-19e1-4f8b-a4cc-df4b283dda1c None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:01.924941 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f810741-19e1-4f8b-a4cc-df4b283dda1c None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:01.925213 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f810741-19e1-4f8b-a4cc-df4b283dda1c None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:01.925870 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f810741-19e1-4f8b-a4cc-df4b283dda1c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:29:01.926176 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f810741-19e1-4f8b-a4cc-df4b283dda1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:01.927634 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f810741-19e1-4f8b-a4cc-df4b283dda1c None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:01.932773 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 463/920] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Aug 23 16:29:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:29:01.939358 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78ce89-c132-495e-94c3-969b6a22a148 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:01.968232 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:02.037035 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78ce89-c132-495e-94c3-969b6a22a148 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:02.068905 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4ff96-cfec-4f06-8dad-181d128a29cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:02.069495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4ff96-cfec-4f06-8dad-181d128a29cc None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:02.069772 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4ff96-cfec-4f06-8dad-181d128a29cc None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:02.070040 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4ff96-cfec-4f06-8dad-181d128a29cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:02.070726 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4ff96-cfec-4f06-8dad-181d128a29cc None admin] RBAC: Adding query filter params (interface=public, service_id=7c1dfb4aa696474c9d79dc78ae83e8c9, region_id=RegionOne) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:29:02.071029 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4ff96-cfec-4f06-8dad-181d128a29cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:02.072410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4ff96-cfec-4f06-8dad-181d128a29cc None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:02.077776 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 458/921] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Aug 23 16:29:01 2022] GET /identity/v3/endpoints?service_id=7c1dfb4aa696474c9d79dc78ae83e8c9&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:29:02.083729 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f810741-19e1-4f8b-a4cc-df4b283dda1c None admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:02.164116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:02.181448 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f810741-19e1-4f8b-a4cc-df4b283dda1c None admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:02.214351 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd386ffc-7e1c-4e0c-807c-6a6ef99de061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:02.214935 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd386ffc-7e1c-4e0c-807c-6a6ef99de061 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:02.218878 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd386ffc-7e1c-4e0c-807c-6a6ef99de061 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:02.218878 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd386ffc-7e1c-4e0c-807c-6a6ef99de061 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:02.218878 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd386ffc-7e1c-4e0c-807c-6a6ef99de061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:02.218878 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd386ffc-7e1c-4e0c-807c-6a6ef99de061 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:02.223805 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 464/922] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Aug 23 16:29:02 2022] GET /identity/v3/services => generated 1962 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:29:04.428260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0ca98-8425-46b1-bee2-85fcdf726186 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:04.428815 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0ca98-8425-46b1-bee2-85fcdf726186 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:04.428815 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0ca98-8425-46b1-bee2-85fcdf726186 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:04.430111 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 459/923] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:29:04.435401 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594afdc-f9b2-4f34-9818-f68d3ebc41eb None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:04.435848 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594afdc-f9b2-4f34-9818-f68d3ebc41eb None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:04.435950 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594afdc-f9b2-4f34-9818-f68d3ebc41eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:04.453593 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-b594afdc-f9b2-4f34-9818-f68d3ebc41eb None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:29:04.454777 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-b594afdc-f9b2-4f34-9818-f68d3ebc41eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:04.519926 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 465/924] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:29:04 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:29:04.846534 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0ca98-8425-46b1-bee2-85fcdf726186 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:04.939796 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:04.949017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0ca98-8425-46b1-bee2-85fcdf726186 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:04.981865 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b999f-aba8-447a-ad83-a0009e1d91e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:04.982508 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b999f-aba8-447a-ad83-a0009e1d91e6 None admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:04.982782 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b999f-aba8-447a-ad83-a0009e1d91e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:04.983051 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b999f-aba8-447a-ad83-a0009e1d91e6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:04.983650 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b999f-aba8-447a-ad83-a0009e1d91e6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:04.985016 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b999f-aba8-447a-ad83-a0009e1d91e6 None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application [None req-643b999f-aba8-447a-ad83-a0009e1d91e6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:29:04.993437 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:29:04.994623 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application with Lock( Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: ERROR keystone.server.flask.application Aug 23 16:29:04.995745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 460/925] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Aug 23 16:29:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:29:05.001447 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594afdc-f9b2-4f34-9818-f68d3ebc41eb None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:05.074854 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:05.096689 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594afdc-f9b2-4f34-9818-f68d3ebc41eb None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:05.128921 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9179-87bc-42d9-b844-1ca994eec3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:05.129542 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9179-87bc-42d9-b844-1ca994eec3b0 None admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:05.129817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9179-87bc-42d9-b844-1ca994eec3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:05.130089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9179-87bc-42d9-b844-1ca994eec3b0 None admin] PATH_INFO: `/v3/services` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:05.130769 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a9179-87bc-42d9-b844-1ca994eec3b0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:29:05.131095 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a9179-87bc-42d9-b844-1ca994eec3b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:05.132579 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a9179-87bc-42d9-b844-1ca994eec3b0 None admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:05.137957 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 466/926] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Aug 23 16:29:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:29:05.144407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b999f-aba8-447a-ad83-a0009e1d91e6 None admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:05.245487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b999f-aba8-447a-ad83-a0009e1d91e6 None admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:05.279470 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b2464-8c09-4bb2-bd09-5ef9e2023fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:05.280070 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b2464-8c09-4bb2-bd09-5ef9e2023fea None admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:05.280350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b2464-8c09-4bb2-bd09-5ef9e2023fea None admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:05.280621 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b2464-8c09-4bb2-bd09-5ef9e2023fea None admin] PATH_INFO: `/v3/endpoints` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:05.281266 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b2464-8c09-4bb2-bd09-5ef9e2023fea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:05.282715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b2464-8c09-4bb2-bd09-5ef9e2023fea None admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:05.419217 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 461/927] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Aug 23 16:29:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:29:15.232432 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=30 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:15.414369 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:46.421612 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e505814-598f-44e2-9f5d-477461b15684 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:46.422203 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e505814-598f-44e2-9f5d-477461b15684 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:46.422420 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e505814-598f-44e2-9f5d-477461b15684 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:46.424752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 467/928] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:37:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:37:46.433895 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e054-d532-41e8-837c-edb27f28ef68 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:46.434455 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e054-d532-41e8-837c-edb27f28ef68 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:46.434787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e054-d532-41e8-837c-edb27f28ef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:46.546528 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-0c26e054-d532-41e8-837c-edb27f28ef68 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:46.548002 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-0c26e054-d532-41e8-837c-edb27f28ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:46.669787 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 462/929] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:37:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:47.021048 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f284f83-a75c-413c-b584-84f4cff793b2 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:47.021578 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f284f83-a75c-413c-b584-84f4cff793b2 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:47.022063 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f284f83-a75c-413c-b584-84f4cff793b2 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:47.024631 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 468/930] 10.222.0.18 () {54 vars in 965 bytes} [Tue Aug 23 16:37:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:37:47.031997 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29f8b5-1a84-4b13-a5ca-78ee90930fbc None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:47.032561 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29f8b5-1a84-4b13-a5ca-78ee90930fbc None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:47.033060 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29f8b5-1a84-4b13-a5ca-78ee90930fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:47.160222 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-cd29f8b5-1a84-4b13-a5ca-78ee90930fbc None None] MFA Rules not processed for user `74e4ab73defe45cb90e60e5719c5d0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:47.161689 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-cd29f8b5-1a84-4b13-a5ca-78ee90930fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:47.203519 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:47.276059 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 463/931] 10.222.0.18 () {58 vars in 1062 bytes} [Tue Aug 23 16:37:47 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:47.290418 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f284f83-a75c-413c-b584-84f4cff793b2 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:47.304382 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f284f83-a75c-413c-b584-84f4cff793b2 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:47.308426 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a66b3-2278-42de-b144-5c6004a8694f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:47.309066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a66b3-2278-42de-b144-5c6004a8694f service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:47.309339 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a66b3-2278-42de-b144-5c6004a8694f service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:47.309905 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a66b3-2278-42de-b144-5c6004a8694f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:47.323495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a66b3-2278-42de-b144-5c6004a8694f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:47.325413 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a66b3-2278-42de-b144-5c6004a8694f service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:47.340272 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 469/932] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:37:50.192055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9717b6-bf5f-4e03-9a5a-22bc6058ec09 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:50.193059 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9717b6-bf5f-4e03-9a5a-22bc6058ec09 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:50.193378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9717b6-bf5f-4e03-9a5a-22bc6058ec09 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:50.195283 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 464/933] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:37:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:37:50.204079 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3679f-8064-4bdc-a778-f194b0c9d979 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:50.204623 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3679f-8064-4bdc-a778-f194b0c9d979 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:50.205086 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3679f-8064-4bdc-a778-f194b0c9d979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:50.241015 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-c6c3679f-8064-4bdc-a778-f194b0c9d979 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:50.243128 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-c6c3679f-8064-4bdc-a778-f194b0c9d979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:50.257024 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 470/934] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:37:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:50.883088 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9717b6-bf5f-4e03-9a5a-22bc6058ec09 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:50.896144 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9717b6-bf5f-4e03-9a5a-22bc6058ec09 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:50.900855 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde7702-e7f5-4595-a3b2-304beaa635e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:50.901620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7702-e7f5-4595-a3b2-304beaa635e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:50.902613 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7702-e7f5-4595-a3b2-304beaa635e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:50.902613 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7702-e7f5-4595-a3b2-304beaa635e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:50.916281 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde7702-e7f5-4595-a3b2-304beaa635e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:50.918540 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde7702-e7f5-4595-a3b2-304beaa635e1 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:50.932867 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 465/935] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:37:54.075562 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfcd9d-0783-4601-a31e-85a8515fbdc0 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:54.076119 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfcd9d-0783-4601-a31e-85a8515fbdc0 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:54.076119 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfcd9d-0783-4601-a31e-85a8515fbdc0 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:54.077351 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 471/936] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:37:54.082927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037ce98-7e88-482d-a6d6-f5a4fff41108 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:54.083454 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037ce98-7e88-482d-a6d6-f5a4fff41108 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:54.083700 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037ce98-7e88-482d-a6d6-f5a4fff41108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:54.147603 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-2037ce98-7e88-482d-a6d6-f5a4fff41108 None None] MFA Rules not processed for user `c335a23dde39460b97b39ea387e956fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:54.148860 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-2037ce98-7e88-482d-a6d6-f5a4fff41108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:54.244961 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 466/937] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:37:54 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:54.592278 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfcd9d-0783-4601-a31e-85a8515fbdc0 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:54.603091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfcd9d-0783-4601-a31e-85a8515fbdc0 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:54.606744 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937d532-a805-4100-b4ae-2896f7ee95a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:54.607383 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d532-a805-4100-b4ae-2896f7ee95a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:54.607662 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d532-a805-4100-b4ae-2896f7ee95a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:54.607934 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d532-a805-4100-b4ae-2896f7ee95a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:54.618216 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937d532-a805-4100-b4ae-2896f7ee95a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:54.619703 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937d532-a805-4100-b4ae-2896f7ee95a4 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:54.629930 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 472/938] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:54 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:58.158192 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e26b98-d5ac-4039-9cdf-3fcca47ea76b None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:58.158721 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e26b98-d5ac-4039-9cdf-3fcca47ea76b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:58.158721 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e26b98-d5ac-4039-9cdf-3fcca47ea76b None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:58.160055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 467/939] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:37:58.168659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1ef33-ae22-49d8-9b65-ef42c6a892a6 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:58.169307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1ef33-ae22-49d8-9b65-ef42c6a892a6 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:58.169307 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1ef33-ae22-49d8-9b65-ef42c6a892a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:58.193147 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-24d1ef33-ae22-49d8-9b65-ef42c6a892a6 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:58.194543 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-24d1ef33-ae22-49d8-9b65-ef42c6a892a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:58.274281 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 473/940] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:37:58 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:58.616839 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e26b98-d5ac-4039-9cdf-3fcca47ea76b None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:58.627803 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e26b98-d5ac-4039-9cdf-3fcca47ea76b None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:58.631368 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac1bca-9a64-43aa-9ae3-9b7d45943ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:58.632019 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac1bca-9a64-43aa-9ae3-9b7d45943ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:58.632294 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac1bca-9a64-43aa-9ae3-9b7d45943ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:58.632563 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac1bca-9a64-43aa-9ae3-9b7d45943ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:58.642703 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac1bca-9a64-43aa-9ae3-9b7d45943ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:58.644293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac1bca-9a64-43aa-9ae3-9b7d45943ea1 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:58.654968 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 468/941] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:58 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:02.721589 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814b9fb-e472-43a7-9920-c33a44475067 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:02.722130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814b9fb-e472-43a7-9920-c33a44475067 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:02.722224 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814b9fb-e472-43a7-9920-c33a44475067 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:02.724056 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 474/942] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:02.730634 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990663-eed0-4a42-9f8a-1153d28a21e5 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:02.731090 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990663-eed0-4a42-9f8a-1153d28a21e5 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:02.731406 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990663-eed0-4a42-9f8a-1153d28a21e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:02.755357 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-73990663-eed0-4a42-9f8a-1153d28a21e5 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:02.757480 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-73990663-eed0-4a42-9f8a-1153d28a21e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:02.767645 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 469/943] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:38:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:03.246842 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814b9fb-e472-43a7-9920-c33a44475067 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:03.259413 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814b9fb-e472-43a7-9920-c33a44475067 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:03.263021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb31b64-b9c9-4e9d-8ac9-fd55b4364102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:03.263672 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb31b64-b9c9-4e9d-8ac9-fd55b4364102 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:03.263952 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb31b64-b9c9-4e9d-8ac9-fd55b4364102 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:03.264222 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb31b64-b9c9-4e9d-8ac9-fd55b4364102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:03.274461 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb31b64-b9c9-4e9d-8ac9-fd55b4364102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:03.275967 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb31b64-b9c9-4e9d-8ac9-fd55b4364102 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:03.287890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 475/944] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:05.672379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a69f4-0032-4697-9d9c-ee11186050b6 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:05.672915 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a69f4-0032-4697-9d9c-ee11186050b6 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:05.672915 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a69f4-0032-4697-9d9c-ee11186050b6 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:05.674238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 470/945] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:05.679954 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d48767-0ec3-4daf-b3b2-14723a85e151 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:05.680455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d48767-0ec3-4daf-b3b2-14723a85e151 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:05.680553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d48767-0ec3-4daf-b3b2-14723a85e151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:05.699661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-66d48767-0ec3-4daf-b3b2-14723a85e151 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:05.700840 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-66d48767-0ec3-4daf-b3b2-14723a85e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:05.708763 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 476/946] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:38:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:06.055696 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a69f4-0032-4697-9d9c-ee11186050b6 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:06.067072 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a69f4-0032-4697-9d9c-ee11186050b6 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:06.071202 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f2ee4-c94b-49e4-966c-eeccb93b9e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:06.071840 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2ee4-c94b-49e4-966c-eeccb93b9e1b service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:06.072118 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2ee4-c94b-49e4-966c-eeccb93b9e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:06.072392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2ee4-c94b-49e4-966c-eeccb93b9e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:06.081985 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f2ee4-c94b-49e4-966c-eeccb93b9e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:06.083460 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f2ee4-c94b-49e4-966c-eeccb93b9e1b service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:06.093138 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 471/947] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:08.378577 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd006f-b61a-4343-8690-4a853af4950a None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:08.379084 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd006f-b61a-4343-8690-4a853af4950a None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:08.379084 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd006f-b61a-4343-8690-4a853af4950a None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:08.380521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 477/948] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:08.386249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dab62-7fbd-4860-a789-002681465a99 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:08.386777 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dab62-7fbd-4860-a789-002681465a99 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:08.387070 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dab62-7fbd-4860-a789-002681465a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:08.410417 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-931dab62-7fbd-4860-a789-002681465a99 None None] MFA Rules not processed for user `c335a23dde39460b97b39ea387e956fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:08.411710 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-931dab62-7fbd-4860-a789-002681465a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:08.421021 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 472/949] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:38:08 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:08.823051 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e152-2c8f-41a8-91ca-eb851bbc844f None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:08.823353 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e152-2c8f-41a8-91ca-eb851bbc844f None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:08.823631 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e152-2c8f-41a8-91ca-eb851bbc844f None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:08.824980 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 478/950] 10.222.0.18 () {54 vars in 965 bytes} [Tue Aug 23 16:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:08.831727 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6b1c-34bf-407e-bab2-c82137328c35 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:08.832197 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6b1c-34bf-407e-bab2-c82137328c35 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:08.832569 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6b1c-34bf-407e-bab2-c82137328c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:08.853397 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-817a6b1c-34bf-407e-bab2-c82137328c35 None None] MFA Rules not processed for user `74e4ab73defe45cb90e60e5719c5d0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:08.854706 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-817a6b1c-34bf-407e-bab2-c82137328c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:08.861950 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 473/951] 10.222.0.18 () {58 vars in 1062 bytes} [Tue Aug 23 16:38:08 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:08.871464 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570e152-2c8f-41a8-91ca-eb851bbc844f None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:08.883157 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570e152-2c8f-41a8-91ca-eb851bbc844f None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:08.886854 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46560721-cff6-4de8-b93f-d1f5c9553de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:08.887506 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46560721-cff6-4de8-b93f-d1f5c9553de0 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:08.887780 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46560721-cff6-4de8-b93f-d1f5c9553de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:08.888054 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46560721-cff6-4de8-b93f-d1f5c9553de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:08.898071 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46560721-cff6-4de8-b93f-d1f5c9553de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:08.899632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46560721-cff6-4de8-b93f-d1f5c9553de0 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:08.911249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 479/952] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:08 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:12.495136 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff82b-3a2e-42e1-87cf-6cfa347a9880 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:12.495729 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff82b-3a2e-42e1-87cf-6cfa347a9880 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:12.495729 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff82b-3a2e-42e1-87cf-6cfa347a9880 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:12.497134 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 474/953] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:38:12.502973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99206f-d34f-4f49-bdf6-9ad33fa94d04 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:12.503547 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99206f-d34f-4f49-bdf6-9ad33fa94d04 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:12.503547 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99206f-d34f-4f49-bdf6-9ad33fa94d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:12.526756 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-aa99206f-d34f-4f49-bdf6-9ad33fa94d04 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:12.528013 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-aa99206f-d34f-4f49-bdf6-9ad33fa94d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:12.536076 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 480/954] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:38:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:12.947364 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ff82b-3a2e-42e1-87cf-6cfa347a9880 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:12.956360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=100 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:12.962034 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ff82b-3a2e-42e1-87cf-6cfa347a9880 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:12.966079 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbefcb0-c621-4078-8719-6eb8aaf55866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:12.967481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbefcb0-c621-4078-8719-6eb8aaf55866 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:12.967481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbefcb0-c621-4078-8719-6eb8aaf55866 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:12.967481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbefcb0-c621-4078-8719-6eb8aaf55866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:12.978708 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbefcb0-c621-4078-8719-6eb8aaf55866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:12.980494 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbefcb0-c621-4078-8719-6eb8aaf55866 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:12.991545 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 475/955] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:15.370322 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6ca06-3764-49eb-9acb-aed897a2819e None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:15.370828 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6ca06-3764-49eb-9acb-aed897a2819e None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:15.370828 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6ca06-3764-49eb-9acb-aed897a2819e None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:15.372186 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 481/956] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:15.377786 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d194c-06ed-40fa-94fd-2e7c55fff1cf None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:15.378222 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d194c-06ed-40fa-94fd-2e7c55fff1cf None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:15.378330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d194c-06ed-40fa-94fd-2e7c55fff1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:15.397626 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-6b5d194c-06ed-40fa-94fd-2e7c55fff1cf None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:15.399998 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-6b5d194c-06ed-40fa-94fd-2e7c55fff1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:15.406639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 476/957] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:38:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:15.748633 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6ca06-3764-49eb-9acb-aed897a2819e None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:15.756106 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=65 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:15.762249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6ca06-3764-49eb-9acb-aed897a2819e None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:15.772974 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f671a-12c7-4478-9686-0c799a95ed9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:15.773608 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f671a-12c7-4478-9686-0c799a95ed9a service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:15.773894 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f671a-12c7-4478-9686-0c799a95ed9a service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:15.774160 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f671a-12c7-4478-9686-0c799a95ed9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:15.785999 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f671a-12c7-4478-9686-0c799a95ed9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:15.789564 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f671a-12c7-4478-9686-0c799a95ed9a service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:15.807484 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 482/958] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:18.650306 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9477ec-4f8a-43c4-9138-b5a1d684811b None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:18.650802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9477ec-4f8a-43c4-9138-b5a1d684811b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:18.650931 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9477ec-4f8a-43c4-9138-b5a1d684811b None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:18.652220 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 477/959] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:38:18.657698 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b9945-6e27-4b0e-9401-42f0c09e8c7e None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:18.658170 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b9945-6e27-4b0e-9401-42f0c09e8c7e None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:18.658302 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b9945-6e27-4b0e-9401-42f0c09e8c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:18.677793 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-d55b9945-6e27-4b0e-9401-42f0c09e8c7e None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:18.682293 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-d55b9945-6e27-4b0e-9401-42f0c09e8c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:18.687502 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 483/960] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:38:18 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:19.027351 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9477ec-4f8a-43c4-9138-b5a1d684811b None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:19.046292 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9477ec-4f8a-43c4-9138-b5a1d684811b None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:19.052284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e7f5c-8e88-4c8a-9771-db32a58a1866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:19.054103 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e7f5c-8e88-4c8a-9771-db32a58a1866 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:19.054618 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e7f5c-8e88-4c8a-9771-db32a58a1866 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:19.055124 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e7f5c-8e88-4c8a-9771-db32a58a1866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:19.072010 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e7f5c-8e88-4c8a-9771-db32a58a1866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:19.074851 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e7f5c-8e88-4c8a-9771-db32a58a1866 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:19.092987 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 478/961] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:19 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:24.296731 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1d863-e61b-42ef-a5cf-b3d8f62bcda1 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:24.297294 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1d863-e61b-42ef-a5cf-b3d8f62bcda1 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:24.297294 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1d863-e61b-42ef-a5cf-b3d8f62bcda1 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:24.298622 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 484/962] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:24.305308 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345c0e8-87f4-467d-b9a3-245bb702c648 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:24.305807 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345c0e8-87f4-467d-b9a3-245bb702c648 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:24.305907 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345c0e8-87f4-467d-b9a3-245bb702c648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:24.330960 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-f345c0e8-87f4-467d-b9a3-245bb702c648 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:24.332228 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-f345c0e8-87f4-467d-b9a3-245bb702c648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:24.340469 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 479/963] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:38:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:24.683461 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1d863-e61b-42ef-a5cf-b3d8f62bcda1 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:24.702407 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1d863-e61b-42ef-a5cf-b3d8f62bcda1 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:24.708794 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dcd1e-c82e-4822-9aac-8b03eb81be0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:24.710398 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dcd1e-c82e-4822-9aac-8b03eb81be0a service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:24.710918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dcd1e-c82e-4822-9aac-8b03eb81be0a service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:24.711479 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dcd1e-c82e-4822-9aac-8b03eb81be0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:24.735078 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dcd1e-c82e-4822-9aac-8b03eb81be0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:24.737754 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dcd1e-c82e-4822-9aac-8b03eb81be0a service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:24.750040 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 485/964] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:28.070554 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2f06c-04aa-4c53-a572-8d09e99b62fa None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:28.071100 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2f06c-04aa-4c53-a572-8d09e99b62fa None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:28.071100 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2f06c-04aa-4c53-a572-8d09e99b62fa None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:28.072350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 480/965] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:28.083988 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e1882-1136-4894-b0c8-b66325edd789 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:28.084547 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e1882-1136-4894-b0c8-b66325edd789 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:28.084547 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e1882-1136-4894-b0c8-b66325edd789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:28.107989 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-8e9e1882-1136-4894-b0c8-b66325edd789 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:28.109185 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-8e9e1882-1136-4894-b0c8-b66325edd789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:28.119891 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 486/966] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:38:28 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:28.464519 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2f06c-04aa-4c53-a572-8d09e99b62fa None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:28.475967 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2f06c-04aa-4c53-a572-8d09e99b62fa None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:28.479895 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fe148-4c41-4702-b8cd-2cbc5bc55192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:28.480504 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fe148-4c41-4702-b8cd-2cbc5bc55192 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:28.480779 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fe148-4c41-4702-b8cd-2cbc5bc55192 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:28.481051 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fe148-4c41-4702-b8cd-2cbc5bc55192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:28.490751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fe148-4c41-4702-b8cd-2cbc5bc55192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:28.492226 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fe148-4c41-4702-b8cd-2cbc5bc55192 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:28.502195 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 481/967] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:28 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:33.519907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca16b1-2839-40ed-89c4-7eb7b56149a3 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:33.520440 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca16b1-2839-40ed-89c4-7eb7b56149a3 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:33.520440 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca16b1-2839-40ed-89c4-7eb7b56149a3 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:33.521801 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 487/968] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:33.528078 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba78f4a-8624-4a7e-a606-776c0eae3e05 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:33.528559 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba78f4a-8624-4a7e-a606-776c0eae3e05 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:33.528678 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba78f4a-8624-4a7e-a606-776c0eae3e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:33.549340 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-6ba78f4a-8624-4a7e-a606-776c0eae3e05 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:33.550554 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-6ba78f4a-8624-4a7e-a606-776c0eae3e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:33.558483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 482/969] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:38:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:33.897929 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca16b1-2839-40ed-89c4-7eb7b56149a3 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:33.908905 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca16b1-2839-40ed-89c4-7eb7b56149a3 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:33.912462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02dcfc-1ef2-4864-926a-1ea34fa93817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:33.913663 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02dcfc-1ef2-4864-926a-1ea34fa93817 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:33.913935 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02dcfc-1ef2-4864-926a-1ea34fa93817 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:33.914202 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02dcfc-1ef2-4864-926a-1ea34fa93817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:33.924040 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02dcfc-1ef2-4864-926a-1ea34fa93817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:33.925542 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02dcfc-1ef2-4864-926a-1ea34fa93817 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:33.935865 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 488/970] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:39.604153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecaa90-9fd2-4a96-9895-a972aaf19d0b None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:39.605142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecaa90-9fd2-4a96-9895-a972aaf19d0b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:39.605670 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecaa90-9fd2-4a96-9895-a972aaf19d0b None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:39.607645 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 483/971] 10.222.0.18 () {54 vars in 921 bytes} [Tue Aug 23 16:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:39.612677 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b988a73-989e-4372-bd17-2326117b06a3 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:39.613583 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b988a73-989e-4372-bd17-2326117b06a3 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:39.614090 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b988a73-989e-4372-bd17-2326117b06a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:39.744065 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-4b988a73-989e-4372-bd17-2326117b06a3 None None] MFA Rules not processed for user `eef56a81a66744b2a3e468b7f182f9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:39.745317 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-4b988a73-989e-4372-bd17-2326117b06a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:39.827346 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 489/972] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Aug 23 16:38:39 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:43.543910 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=25 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:44.607896 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd94f1b-69f9-4872-8004-9b99d1ce3f87 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:44.608557 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd94f1b-69f9-4872-8004-9b99d1ce3f87 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:44.608557 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd94f1b-69f9-4872-8004-9b99d1ce3f87 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:44.610115 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 484/973] 10.222.0.18 () {54 vars in 921 bytes} [Tue Aug 23 16:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:44.615664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686cc77-75f5-4dbf-b42b-0d23fa6c7961 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:44.616320 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686cc77-75f5-4dbf-b42b-0d23fa6c7961 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:44.616320 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686cc77-75f5-4dbf-b42b-0d23fa6c7961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:44.637260 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-1686cc77-75f5-4dbf-b42b-0d23fa6c7961 None None] MFA Rules not processed for user `eef56a81a66744b2a3e468b7f182f9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:44.638615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-1686cc77-75f5-4dbf-b42b-0d23fa6c7961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:44.652509 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 490/974] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Aug 23 16:38:44 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:46.207828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dd534-a998-4635-b968-f2bd324e266d None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:46.208408 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dd534-a998-4635-b968-f2bd324e266d None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:46.208515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dd534-a998-4635-b968-f2bd324e266d None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:46.209798 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 485/975] 10.222.0.18 () {54 vars in 921 bytes} [Tue Aug 23 16:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:46.214936 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebeb51-9dc9-49b7-89f8-86fbcf2af6d1 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:46.215506 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebeb51-9dc9-49b7-89f8-86fbcf2af6d1 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:46.215717 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebeb51-9dc9-49b7-89f8-86fbcf2af6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:46.223359 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=71 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:46.237341 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-35ebeb51-9dc9-49b7-89f8-86fbcf2af6d1 None None] MFA Rules not processed for user `eef56a81a66744b2a3e468b7f182f9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:46.238532 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-35ebeb51-9dc9-49b7-89f8-86fbcf2af6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:46.247576 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 491/976] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Aug 23 16:38:46 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:38:50.257562 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31150cd7-82ec-4b5c-86a6-7594f6b7270b None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:50.258148 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31150cd7-82ec-4b5c-86a6-7594f6b7270b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:50.258148 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31150cd7-82ec-4b5c-86a6-7594f6b7270b None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:50.259501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 486/977] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:38:50.265364 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f926005-5b34-4558-bf28-6e47c91cb0a7 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:50.265828 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f926005-5b34-4558-bf28-6e47c91cb0a7 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:50.265918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f926005-5b34-4558-bf28-6e47c91cb0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:50.290389 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-4f926005-5b34-4558-bf28-6e47c91cb0a7 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:50.291903 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-4f926005-5b34-4558-bf28-6e47c91cb0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:50.304359 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 492/978] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:38:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:38:50.686654 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075c2c1-c2ff-4153-8794-c18b21cb959c None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:50.687165 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075c2c1-c2ff-4153-8794-c18b21cb959c None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:50.687802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075c2c1-c2ff-4153-8794-c18b21cb959c None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:50.689383 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 487/979] 10.222.0.18 () {54 vars in 962 bytes} [Tue Aug 23 16:38:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:50.697158 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073d730-dcd0-4285-9e3d-04c507a412c5 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:50.697891 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073d730-dcd0-4285-9e3d-04c507a412c5 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:50.698738 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073d730-dcd0-4285-9e3d-04c507a412c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:50.762517 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-4073d730-dcd0-4285-9e3d-04c507a412c5 None None] MFA Rules not processed for user `db2c2345bf6e487bb3451fd6ce17f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:50.763802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-4073d730-dcd0-4285-9e3d-04c507a412c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:50.851312 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 493/980] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Aug 23 16:38:50 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:50.859335 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075c2c1-c2ff-4153-8794-c18b21cb959c None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:50.874149 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075c2c1-c2ff-4153-8794-c18b21cb959c None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:50.880021 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59ea16-de45-458d-9bd6-4918ea6fcd21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:50.880864 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59ea16-de45-458d-9bd6-4918ea6fcd21 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:50.881324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59ea16-de45-458d-9bd6-4918ea6fcd21 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:50.881811 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59ea16-de45-458d-9bd6-4918ea6fcd21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:50.891408 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59ea16-de45-458d-9bd6-4918ea6fcd21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:50.893349 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59ea16-de45-458d-9bd6-4918ea6fcd21 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:50.904522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 488/981] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:53.377150 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b719373-856c-4d62-8da2-ef95631074d0 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:53.377684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b719373-856c-4d62-8da2-ef95631074d0 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:53.377684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b719373-856c-4d62-8da2-ef95631074d0 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:53.379118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 494/982] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:53.384652 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac2613-68d7-4551-a7a1-49fd1468a808 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:53.385370 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac2613-68d7-4551-a7a1-49fd1468a808 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:53.385370 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac2613-68d7-4551-a7a1-49fd1468a808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:53.404843 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-e1ac2613-68d7-4551-a7a1-49fd1468a808 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:53.406047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-e1ac2613-68d7-4551-a7a1-49fd1468a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:53.415088 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 489/983] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:38:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:53.785881 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b719373-856c-4d62-8da2-ef95631074d0 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:53.812889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b719373-856c-4d62-8da2-ef95631074d0 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:53.821939 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5152b4f-ae9b-40e2-9cbc-8659a2e8601e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:53.823116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5152b4f-ae9b-40e2-9cbc-8659a2e8601e service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:53.824246 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5152b4f-ae9b-40e2-9cbc-8659a2e8601e service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:53.824885 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5152b4f-ae9b-40e2-9cbc-8659a2e8601e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:53.845817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5152b4f-ae9b-40e2-9cbc-8659a2e8601e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:53.849380 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5152b4f-ae9b-40e2-9cbc-8659a2e8601e service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:53.869565 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 495/984] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:56.619596 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36cd27-b993-45b2-8d67-91d28606f511 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:56.620165 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36cd27-b993-45b2-8d67-91d28606f511 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:56.620165 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36cd27-b993-45b2-8d67-91d28606f511 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:56.621505 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 490/985] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:56.627038 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e1a6-e97d-4456-be6e-2f0ab6b0c4d4 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:56.628831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e1a6-e97d-4456-be6e-2f0ab6b0c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:56.628831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e1a6-e97d-4456-be6e-2f0ab6b0c4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:56.648285 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-0065e1a6-e97d-4456-be6e-2f0ab6b0c4d4 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:56.649675 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-0065e1a6-e97d-4456-be6e-2f0ab6b0c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:56.662877 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 496/986] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:38:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:57.026075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56763b92-faf1-4ce4-8597-a31786817809 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:57.026359 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56763b92-faf1-4ce4-8597-a31786817809 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:57.026823 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56763b92-faf1-4ce4-8597-a31786817809 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:57.028445 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 491/987] 10.222.0.18 () {54 vars in 962 bytes} [Tue Aug 23 16:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:57.034700 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa332e7-bad1-468b-be0c-7b89d33ec2be None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:57.035198 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa332e7-bad1-468b-be0c-7b89d33ec2be None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:57.035502 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa332e7-bad1-468b-be0c-7b89d33ec2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:57.060156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-afa332e7-bad1-468b-be0c-7b89d33ec2be None None] MFA Rules not processed for user `db2c2345bf6e487bb3451fd6ce17f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:57.061371 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-afa332e7-bad1-468b-be0c-7b89d33ec2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:57.070703 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 497/988] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Aug 23 16:38:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:57.078724 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56763b92-faf1-4ce4-8597-a31786817809 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:57.095939 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56763b92-faf1-4ce4-8597-a31786817809 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:57.101368 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35465a-341c-4bda-a7cc-20e2003c3502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:57.102775 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35465a-341c-4bda-a7cc-20e2003c3502 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:57.102775 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35465a-341c-4bda-a7cc-20e2003c3502 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:57.102775 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35465a-341c-4bda-a7cc-20e2003c3502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:57.111801 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35465a-341c-4bda-a7cc-20e2003c3502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:57.113398 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35465a-341c-4bda-a7cc-20e2003c3502 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:57.124386 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 492/989] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:59.683056 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3475f-d4e3-4cd0-a088-bf026371b98e None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:59.684141 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3475f-d4e3-4cd0-a088-bf026371b98e None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:59.684655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3475f-d4e3-4cd0-a088-bf026371b98e None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:59.690254 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 498/990] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:38:59.692414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53732789-feea-4635-9cca-9c642dbcf1ea None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:59.693266 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53732789-feea-4635-9cca-9c642dbcf1ea None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:59.693745 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53732789-feea-4635-9cca-9c642dbcf1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:59.718257 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-53732789-feea-4635-9cca-9c642dbcf1ea None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:59.719880 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-53732789-feea-4635-9cca-9c642dbcf1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:59.739713 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 493/991] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:38:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:00.112064 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3475f-d4e3-4cd0-a088-bf026371b98e None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:00.127065 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3475f-d4e3-4cd0-a088-bf026371b98e None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:00.133146 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa8c5e-709f-4e66-bfbd-8191e6cf2787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:00.134023 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa8c5e-709f-4e66-bfbd-8191e6cf2787 service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:00.134520 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa8c5e-709f-4e66-bfbd-8191e6cf2787 service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:00.135016 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa8c5e-709f-4e66-bfbd-8191e6cf2787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:00.144105 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa8c5e-709f-4e66-bfbd-8191e6cf2787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:00.145978 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa8c5e-709f-4e66-bfbd-8191e6cf2787 service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:00.167791 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 499/992] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:01.171326 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2db0-85f6-4fbb-9349-bbebb78cb727 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:01.172494 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2db0-85f6-4fbb-9349-bbebb78cb727 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:01.173183 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2db0-85f6-4fbb-9349-bbebb78cb727 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:01.184417 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab71b8-b2e4-4ae9-9418-ee462a621ef1 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:01.185699 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab71b8-b2e4-4ae9-9418-ee462a621ef1 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:01.186466 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab71b8-b2e4-4ae9-9418-ee462a621ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:01.190272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 494/993] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:39:01 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:01.229989 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-0dab71b8-b2e4-4ae9-9418-ee462a621ef1 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:01.233035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-0dab71b8-b2e4-4ae9-9418-ee462a621ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:01.257340 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 500/994] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:39:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:01.922029 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a969d-81fe-4c5c-b6a8-e1a9aececa88 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:01.922533 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a969d-81fe-4c5c-b6a8-e1a9aececa88 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:01.922726 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a969d-81fe-4c5c-b6a8-e1a9aececa88 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:01.924288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 495/995] 10.222.0.18 () {54 vars in 964 bytes} [Tue Aug 23 16:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:01.930253 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d725b6-7848-4fb4-a9bf-dc4d3a44ae48 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:01.930611 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d725b6-7848-4fb4-a9bf-dc4d3a44ae48 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:01.931300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d725b6-7848-4fb4-a9bf-dc4d3a44ae48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:02.002239 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-67d725b6-7848-4fb4-a9bf-dc4d3a44ae48 None None] MFA Rules not processed for user `0e1b4d1056614edea1585de5e531ed96`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:02.004029 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-67d725b6-7848-4fb4-a9bf-dc4d3a44ae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:02.052368 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:02.082843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 501/996] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Aug 23 16:39:01 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:02.091867 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a969d-81fe-4c5c-b6a8-e1a9aececa88 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:02.105284 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a969d-81fe-4c5c-b6a8-e1a9aececa88 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:02.109389 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff2ded-34ed-4809-9adc-ba399b92c4d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e1b4d1056614edea1585de5e531ed96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:02.110025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff2ded-34ed-4809-9adc-ba399b92c4d7 service cinder] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:02.110301 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff2ded-34ed-4809-9adc-ba399b92c4d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:02.110575 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff2ded-34ed-4809-9adc-ba399b92c4d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:02.120949 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff2ded-34ed-4809-9adc-ba399b92c4d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:02.122418 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff2ded-34ed-4809-9adc-ba399b92c4d7 service cinder] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:02.133535 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 496/997] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:02.736908 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad460b08-df7e-4ac6-a7de-51b649775961 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:02.737456 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad460b08-df7e-4ac6-a7de-51b649775961 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:02.737456 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad460b08-df7e-4ac6-a7de-51b649775961 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:02.738838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 502/998] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:39:02.745584 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011d1b8-c844-4175-baf4-e57b4a142b20 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:02.746582 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011d1b8-c844-4175-baf4-e57b4a142b20 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:02.747053 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011d1b8-c844-4175-baf4-e57b4a142b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:02.771381 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-5011d1b8-c844-4175-baf4-e57b4a142b20 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:02.772980 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-5011d1b8-c844-4175-baf4-e57b4a142b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:02.787273 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 497/999] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:39:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:03.133346 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad460b08-df7e-4ac6-a7de-51b649775961 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:03.146261 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad460b08-df7e-4ac6-a7de-51b649775961 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:03.152313 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c54a3-5649-49d3-ab1a-4a4bb1789c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:03.152922 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c54a3-5649-49d3-ab1a-4a4bb1789c23 service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:03.153205 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c54a3-5649-49d3-ab1a-4a4bb1789c23 service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:03.153487 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c54a3-5649-49d3-ab1a-4a4bb1789c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:03.169471 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c54a3-5649-49d3-ab1a-4a4bb1789c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:03.171838 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c54a3-5649-49d3-ab1a-4a4bb1789c23 service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:03.201536 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 503/1000] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:05.645625 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41b8a-d7cf-47ac-a9fa-627213891ada None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:05.646179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41b8a-d7cf-47ac-a9fa-627213891ada None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:05.646179 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41b8a-d7cf-47ac-a9fa-627213891ada None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:05.647456 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 498/1001] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:05.653420 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cdd0d-1691-454f-bc9f-f5ad193c48fd None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:05.653831 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cdd0d-1691-454f-bc9f-f5ad193c48fd None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:05.653938 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cdd0d-1691-454f-bc9f-f5ad193c48fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:05.673316 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-d04cdd0d-1691-454f-bc9f-f5ad193c48fd None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:05.674578 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-d04cdd0d-1691-454f-bc9f-f5ad193c48fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:05.683798 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 504/1002] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:39:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:06.033522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb41b8a-d7cf-47ac-a9fa-627213891ada None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:06.049117 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb41b8a-d7cf-47ac-a9fa-627213891ada None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:06.053194 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989288c-0e9a-4711-b13e-1a684986bcef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:06.054515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989288c-0e9a-4711-b13e-1a684986bcef service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:06.054793 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989288c-0e9a-4711-b13e-1a684986bcef service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:06.055064 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989288c-0e9a-4711-b13e-1a684986bcef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:06.064041 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989288c-0e9a-4711-b13e-1a684986bcef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:06.065638 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989288c-0e9a-4711-b13e-1a684986bcef service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:06.076149 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 499/1003] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:08.584189 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85220c0d-176d-4dff-bb37-b9909497fc3a None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:08.584777 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85220c0d-176d-4dff-bb37-b9909497fc3a None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:08.584777 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85220c0d-176d-4dff-bb37-b9909497fc3a None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:08.586098 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 505/1004] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:08.591913 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283223-1b18-44eb-a396-c942c09bd822 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:08.592428 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283223-1b18-44eb-a396-c942c09bd822 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:08.592428 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283223-1b18-44eb-a396-c942c09bd822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:08.612522 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-af283223-1b18-44eb-a396-c942c09bd822 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:08.613734 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-af283223-1b18-44eb-a396-c942c09bd822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:08.623132 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 500/1005] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:39:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:39:08.980755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85220c0d-176d-4dff-bb37-b9909497fc3a None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:09.002161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85220c0d-176d-4dff-bb37-b9909497fc3a None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:09.010402 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6321689-64e5-4574-ba83-c2196cb4a40c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:09.011384 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6321689-64e5-4574-ba83-c2196cb4a40c service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:09.011847 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6321689-64e5-4574-ba83-c2196cb4a40c service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:09.012295 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6321689-64e5-4574-ba83-c2196cb4a40c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:09.026911 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6321689-64e5-4574-ba83-c2196cb4a40c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:09.029749 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6321689-64e5-4574-ba83-c2196cb4a40c service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:09.047725 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 506/1006] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:11.379540 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65868e-c5a2-4ebf-8f68-8241bf232eb9 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:11.380086 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65868e-c5a2-4ebf-8f68-8241bf232eb9 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:11.380086 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65868e-c5a2-4ebf-8f68-8241bf232eb9 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:11.381347 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 501/1007] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:11.387042 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6e423-bb3d-4b3d-9e9d-653527eb2490 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:11.387537 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6e423-bb3d-4b3d-9e9d-653527eb2490 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:11.387656 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6e423-bb3d-4b3d-9e9d-653527eb2490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:11.410118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-fec6e423-bb3d-4b3d-9e9d-653527eb2490 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:11.411815 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-fec6e423-bb3d-4b3d-9e9d-653527eb2490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:11.423011 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 507/1008] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:39:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:11.957929 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65868e-c5a2-4ebf-8f68-8241bf232eb9 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:11.957929 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65868e-c5a2-4ebf-8f68-8241bf232eb9 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:11.957929 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091b36-ea5e-4caf-99ae-c8f4de058a47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:11.957929 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091b36-ea5e-4caf-99ae-c8f4de058a47 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:11.961198 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091b36-ea5e-4caf-99ae-c8f4de058a47 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:11.961198 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091b36-ea5e-4caf-99ae-c8f4de058a47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:11.961198 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f091b36-ea5e-4caf-99ae-c8f4de058a47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:11.961198 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f091b36-ea5e-4caf-99ae-c8f4de058a47 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:11.961198 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 502/1009] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:15.210071 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1b3c8-662f-4998-a192-c0ddc0d2eea6 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:15.211314 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1b3c8-662f-4998-a192-c0ddc0d2eea6 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:15.211516 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1b3c8-662f-4998-a192-c0ddc0d2eea6 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:15.213440 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 508/1010] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:39:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:15.219514 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941aa3ba-5508-4689-a185-dd35dfd7ebf2 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:15.220611 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941aa3ba-5508-4689-a185-dd35dfd7ebf2 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:15.220611 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941aa3ba-5508-4689-a185-dd35dfd7ebf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:15.228505 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=43 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:15.242395 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-941aa3ba-5508-4689-a185-dd35dfd7ebf2 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:15.245553 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-941aa3ba-5508-4689-a185-dd35dfd7ebf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:15.252452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 503/1011] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:39:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:39:15.765410 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1b3c8-662f-4998-a192-c0ddc0d2eea6 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:15.780575 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1b3c8-662f-4998-a192-c0ddc0d2eea6 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:15.786397 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838c176-20c2-474f-8fdd-3ad84530c2ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:15.787036 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c176-20c2-474f-8fdd-3ad84530c2ab service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:15.787352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c176-20c2-474f-8fdd-3ad84530c2ab service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:15.787625 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c176-20c2-474f-8fdd-3ad84530c2ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:15.798344 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838c176-20c2-474f-8fdd-3ad84530c2ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:15.800614 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838c176-20c2-474f-8fdd-3ad84530c2ab service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:15.814428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 509/1012] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:18.378202 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270492b4-70b9-45cb-bdeb-ea0f8e7ef419 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:18.378841 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270492b4-70b9-45cb-bdeb-ea0f8e7ef419 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:18.378841 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270492b4-70b9-45cb-bdeb-ea0f8e7ef419 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:18.380101 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 504/1013] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:18.386201 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bea024-2a30-4180-b523-293325352742 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:18.386703 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bea024-2a30-4180-b523-293325352742 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:18.386807 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bea024-2a30-4180-b523-293325352742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:18.406463 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-b9bea024-2a30-4180-b523-293325352742 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:18.407777 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-b9bea024-2a30-4180-b523-293325352742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:18.415769 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 510/1014] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:39:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:18.761697 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270492b4-70b9-45cb-bdeb-ea0f8e7ef419 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:18.777226 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270492b4-70b9-45cb-bdeb-ea0f8e7ef419 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:18.782282 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ef2eb-0be4-4e57-bc97-dc88aef81ce9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:18.782905 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ef2eb-0be4-4e57-bc97-dc88aef81ce9 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:18.783189 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ef2eb-0be4-4e57-bc97-dc88aef81ce9 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:18.783583 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ef2eb-0be4-4e57-bc97-dc88aef81ce9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:18.794054 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ef2eb-0be4-4e57-bc97-dc88aef81ce9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:18.796919 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ef2eb-0be4-4e57-bc97-dc88aef81ce9 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:18.807325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 505/1015] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:18.935120 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c5cc8-b20a-48a5-8120-7d4ae564cca8 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:18.935517 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c5cc8-b20a-48a5-8120-7d4ae564cca8 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:18.935800 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c5cc8-b20a-48a5-8120-7d4ae564cca8 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:18.937131 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 511/1016] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:18.942620 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a2d5-7ecf-4df6-a723-2eccaa948487 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:18.945451 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a2d5-7ecf-4df6-a723-2eccaa948487 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:18.945451 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a2d5-7ecf-4df6-a723-2eccaa948487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:18.965199 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-aa99a2d5-7ecf-4df6-a723-2eccaa948487 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:18.966451 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-aa99a2d5-7ecf-4df6-a723-2eccaa948487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:18.975197 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 506/1017] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:39:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:19.328891 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dbc78-8adc-456a-a287-06525a503376 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:19.329169 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dbc78-8adc-456a-a287-06525a503376 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:19.329441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dbc78-8adc-456a-a287-06525a503376 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:19.330818 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 512/1018] 10.222.0.18 () {54 vars in 967 bytes} [Tue Aug 23 16:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:19.336639 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef36cd-971e-422e-a32d-2237947a30bc None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:19.336945 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef36cd-971e-422e-a32d-2237947a30bc None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:19.337225 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef36cd-971e-422e-a32d-2237947a30bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:19.388931 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-23ef36cd-971e-422e-a32d-2237947a30bc None None] MFA Rules not processed for user `a7ffdfa226444449817acbcccb0b1c10`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:19.390058 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-23ef36cd-971e-422e-a32d-2237947a30bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:19.456936 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 507/1019] 10.222.0.18 () {58 vars in 1064 bytes} [Tue Aug 23 16:39:19 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:39:19.464366 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4dbc78-8adc-456a-a287-06525a503376 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:19.475097 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4dbc78-8adc-456a-a287-06525a503376 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:19.478835 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaa00d-a5e9-4dd8-8404-0c4d6421a5f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ffdfa226444449817acbcccb0b1c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:19.479458 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaa00d-a5e9-4dd8-8404-0c4d6421a5f6 service glance] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:19.479733 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaa00d-a5e9-4dd8-8404-0c4d6421a5f6 service glance] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:19.480003 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaa00d-a5e9-4dd8-8404-0c4d6421a5f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:19.490864 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaa00d-a5e9-4dd8-8404-0c4d6421a5f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:19.492871 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaa00d-a5e9-4dd8-8404-0c4d6421a5f6 service glance] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:19.503102 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 513/1020] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:21.183408 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4a0f6-80f4-4238-823c-fa7198d97e61 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:21.184030 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4a0f6-80f4-4238-823c-fa7198d97e61 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:21.184142 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4a0f6-80f4-4238-823c-fa7198d97e61 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:21.185631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 508/1021] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:21.191854 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580086d-9828-4941-938a-68b1d5744ffb None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:21.192463 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580086d-9828-4941-938a-68b1d5744ffb None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:21.192463 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580086d-9828-4941-938a-68b1d5744ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:21.213463 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-9580086d-9828-4941-938a-68b1d5744ffb None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:21.214745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-9580086d-9828-4941-938a-68b1d5744ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:21.229009 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 514/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:39:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:21.587733 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4a0f6-80f4-4238-823c-fa7198d97e61 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:21.600386 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4a0f6-80f4-4238-823c-fa7198d97e61 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:21.606644 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0a666-a0a1-4425-b1c8-03153668b8c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:21.607334 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0a666-a0a1-4425-b1c8-03153668b8c5 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:21.607621 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0a666-a0a1-4425-b1c8-03153668b8c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:21.607893 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0a666-a0a1-4425-b1c8-03153668b8c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:21.617511 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0a666-a0a1-4425-b1c8-03153668b8c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:21.619134 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0a666-a0a1-4425-b1c8-03153668b8c5 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:21.629658 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 509/1023] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:24.243088 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a908f-493b-4c35-9c1c-32b2d5a050e7 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:24.243797 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a908f-493b-4c35-9c1c-32b2d5a050e7 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:24.243797 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a908f-493b-4c35-9c1c-32b2d5a050e7 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:24.245191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 515/1024] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:24.251165 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25aebf-6c78-4a83-a026-ea2af44ca7f0 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:24.255659 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25aebf-6c78-4a83-a026-ea2af44ca7f0 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:24.255659 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25aebf-6c78-4a83-a026-ea2af44ca7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:24.274089 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-1d25aebf-6c78-4a83-a026-ea2af44ca7f0 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:24.275491 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-1d25aebf-6c78-4a83-a026-ea2af44ca7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:24.283811 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 510/1025] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:39:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:24.644296 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a908f-493b-4c35-9c1c-32b2d5a050e7 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:24.659704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a908f-493b-4c35-9c1c-32b2d5a050e7 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:24.665322 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662c556-42ef-4880-a329-ce7534a340bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:24.667772 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662c556-42ef-4880-a329-ce7534a340bf service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:24.667772 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662c556-42ef-4880-a329-ce7534a340bf service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:24.667772 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662c556-42ef-4880-a329-ce7534a340bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:24.675482 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662c556-42ef-4880-a329-ce7534a340bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:24.677251 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662c556-42ef-4880-a329-ce7534a340bf service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:24.687879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 516/1026] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:34.268819 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=58 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:34.683194 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=50 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:35.947216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f9a93-d842-4ecf-9b4a-3d8caf3edcac None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:35.947848 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f9a93-d842-4ecf-9b4a-3d8caf3edcac None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:35.947848 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f9a93-d842-4ecf-9b4a-3d8caf3edcac None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:35.949105 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 511/1027] 10.222.0.18 () {54 vars in 918 bytes} [Tue Aug 23 16:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:35.954208 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f448-e72d-4a5a-9928-2dabb5d1e304 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:35.954642 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f448-e72d-4a5a-9928-2dabb5d1e304 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:35.954751 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f448-e72d-4a5a-9928-2dabb5d1e304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:35.974280 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-5a26f448-e72d-4a5a-9928-2dabb5d1e304 None None] MFA Rules not processed for user `eef56a81a66744b2a3e468b7f182f9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:35.975554 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-5a26f448-e72d-4a5a-9928-2dabb5d1e304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:35.985437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 517/1028] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Aug 23 16:39:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:35.999734 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc8d0-5fb1-47bb-984d-3a2218e279b7 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:36.000017 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc8d0-5fb1-47bb-984d-3a2218e279b7 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:36.000308 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc8d0-5fb1-47bb-984d-3a2218e279b7 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:36.001606 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 512/1029] 10.222.0.18 () {54 vars in 918 bytes} [Tue Aug 23 16:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:36.006186 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178809d-7a7f-463d-b659-85b593ac44cf None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:36.006462 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178809d-7a7f-463d-b659-85b593ac44cf None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:36.006730 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178809d-7a7f-463d-b659-85b593ac44cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:36.030546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-e178809d-7a7f-463d-b659-85b593ac44cf None None] MFA Rules not processed for user `db2c2345bf6e487bb3451fd6ce17f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:36.032261 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-e178809d-7a7f-463d-b659-85b593ac44cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:36.041348 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 518/1030] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Aug 23 16:39:36 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:38.807831 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba9d5b-caea-4006-a21b-1545f4b9696f None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:38.808430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba9d5b-caea-4006-a21b-1545f4b9696f None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:38.808430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba9d5b-caea-4006-a21b-1545f4b9696f None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:38.809711 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 513/1031] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:38.815335 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0a671-1033-4a50-a01c-922fff7bc770 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:38.815811 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0a671-1033-4a50-a01c-922fff7bc770 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:38.815913 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0a671-1033-4a50-a01c-922fff7bc770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:38.835134 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-bbc0a671-1033-4a50-a01c-922fff7bc770 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:38.836917 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-bbc0a671-1033-4a50-a01c-922fff7bc770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:38.844669 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 519/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:39:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:39.201629 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba9d5b-caea-4006-a21b-1545f4b9696f None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:39.214838 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba9d5b-caea-4006-a21b-1545f4b9696f None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:39.220121 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576b4b5-7299-4d07-852f-69d03b13daf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:39.220706 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576b4b5-7299-4d07-852f-69d03b13daf3 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:39.220986 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576b4b5-7299-4d07-852f-69d03b13daf3 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:39.221250 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576b4b5-7299-4d07-852f-69d03b13daf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:39.230846 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576b4b5-7299-4d07-852f-69d03b13daf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:39.232640 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576b4b5-7299-4d07-852f-69d03b13daf3 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:39.244342 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 514/1033] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:40.246745 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df23ead-1fad-4ed6-aa97-b128e41d73fa None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:40.247326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df23ead-1fad-4ed6-aa97-b128e41d73fa None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:40.247326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df23ead-1fad-4ed6-aa97-b128e41d73fa None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:40.248620 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 520/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:40.253876 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f5775-f164-4c2c-8f40-df7e2dfbd474 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:40.254331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f5775-f164-4c2c-8f40-df7e2dfbd474 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:40.254451 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f5775-f164-4c2c-8f40-df7e2dfbd474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:40.274704 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-7a3f5775-f164-4c2c-8f40-df7e2dfbd474 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:40.275943 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-7a3f5775-f164-4c2c-8f40-df7e2dfbd474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:40.283815 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 515/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:39:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:40.499390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df23ead-1fad-4ed6-aa97-b128e41d73fa None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:40.513130 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df23ead-1fad-4ed6-aa97-b128e41d73fa None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:40.518366 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a453eb-fd9f-4722-9f2d-32ad6ce8dc85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:40.519022 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a453eb-fd9f-4722-9f2d-32ad6ce8dc85 service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:40.519346 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a453eb-fd9f-4722-9f2d-32ad6ce8dc85 service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:40.519625 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a453eb-fd9f-4722-9f2d-32ad6ce8dc85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:40.529011 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a453eb-fd9f-4722-9f2d-32ad6ce8dc85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:40.530582 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a453eb-fd9f-4722-9f2d-32ad6ce8dc85 service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:40.540611 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 521/1036] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:41.455288 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7d77-f426-45ba-8fda-e2d1ac23a2df None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:41.455827 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7d77-f426-45ba-8fda-e2d1ac23a2df None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:41.455827 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7d77-f426-45ba-8fda-e2d1ac23a2df None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:41.457163 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 516/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:41.462204 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d5997-5049-4595-a28c-2bd128d54b5f None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:41.462646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d5997-5049-4595-a28c-2bd128d54b5f None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:41.462757 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d5997-5049-4595-a28c-2bd128d54b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:41.482535 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-134d5997-5049-4595-a28c-2bd128d54b5f None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:41.483771 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-134d5997-5049-4595-a28c-2bd128d54b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:41.491760 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 522/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:39:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:41.657389 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a7d77-f426-45ba-8fda-e2d1ac23a2df None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:41.672806 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a7d77-f426-45ba-8fda-e2d1ac23a2df None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:41.678237 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615887ef-9acd-4ed4-96d8-44c14b85653f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:41.678519 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615887ef-9acd-4ed4-96d8-44c14b85653f service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:41.678799 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615887ef-9acd-4ed4-96d8-44c14b85653f service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:41.679106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615887ef-9acd-4ed4-96d8-44c14b85653f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:41.689555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615887ef-9acd-4ed4-96d8-44c14b85653f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:41.691213 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615887ef-9acd-4ed4-96d8-44c14b85653f service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:41.701626 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 517/1039] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:39:42.598951 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c752d-9a0a-4437-86e3-4971b35e01aa None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:42.599554 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c752d-9a0a-4437-86e3-4971b35e01aa None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:42.599677 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c752d-9a0a-4437-86e3-4971b35e01aa None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:42.601272 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 523/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:42.606577 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd117671-3b4d-4826-985d-016e0406c573 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:42.607144 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd117671-3b4d-4826-985d-016e0406c573 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:42.607144 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd117671-3b4d-4826-985d-016e0406c573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:42.627837 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-dd117671-3b4d-4826-985d-016e0406c573 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:42.629055 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-dd117671-3b4d-4826-985d-016e0406c573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:42.637869 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 518/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:39:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:42.801218 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c752d-9a0a-4437-86e3-4971b35e01aa None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:42.815111 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c752d-9a0a-4437-86e3-4971b35e01aa None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:42.820128 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a340b80-b9d8-48b9-b281-f6a3fa0a2ed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:42.821268 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a340b80-b9d8-48b9-b281-f6a3fa0a2ed2 service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:42.821546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a340b80-b9d8-48b9-b281-f6a3fa0a2ed2 service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:42.821818 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a340b80-b9d8-48b9-b281-f6a3fa0a2ed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:42.830162 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a340b80-b9d8-48b9-b281-f6a3fa0a2ed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:42.836902 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a340b80-b9d8-48b9-b281-f6a3fa0a2ed2 service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:42.841523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 524/1042] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:43.755353 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7f345-e80d-4c04-9d5e-ce46cae60bed None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:43.755886 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7f345-e80d-4c04-9d5e-ce46cae60bed None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:43.756057 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7f345-e80d-4c04-9d5e-ce46cae60bed None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:43.757628 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 519/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:39:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:43.762918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991ed1a-b9c0-4de9-a059-8a7b8f7672cc None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:43.763453 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991ed1a-b9c0-4de9-a059-8a7b8f7672cc None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:43.763578 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991ed1a-b9c0-4de9-a059-8a7b8f7672cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:43.783489 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-9991ed1a-b9c0-4de9-a059-8a7b8f7672cc None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:43.784704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-9991ed1a-b9c0-4de9-a059-8a7b8f7672cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:43.793075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 525/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:39:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:43.951728 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7f345-e80d-4c04-9d5e-ce46cae60bed None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:43.965122 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7f345-e80d-4c04-9d5e-ce46cae60bed None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:43.970383 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a146-6fd2-47e5-a778-1b89f675c4e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:43.971003 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a146-6fd2-47e5-a778-1b89f675c4e8 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:43.971322 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a146-6fd2-47e5-a778-1b89f675c4e8 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:43.971599 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a146-6fd2-47e5-a778-1b89f675c4e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:43.981636 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a146-6fd2-47e5-a778-1b89f675c4e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:43.983254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a146-6fd2-47e5-a778-1b89f675c4e8 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:43.993569 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 520/1045] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:44.922288 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb0db7-6e78-4366-87be-8c2d28481f8c None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:44.922934 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb0db7-6e78-4366-87be-8c2d28481f8c None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:44.922934 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb0db7-6e78-4366-87be-8c2d28481f8c None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:44.924243 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 526/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:44.929802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c84743-c3ae-4dd8-8f62-e3c7810cbc34 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:44.930325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c84743-c3ae-4dd8-8f62-e3c7810cbc34 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:44.930325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c84743-c3ae-4dd8-8f62-e3c7810cbc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:44.950147 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-76c84743-c3ae-4dd8-8f62-e3c7810cbc34 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:44.951406 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-76c84743-c3ae-4dd8-8f62-e3c7810cbc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:44.960064 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 521/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:39:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:45.115419 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb0db7-6e78-4366-87be-8c2d28481f8c None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:45.129305 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb0db7-6e78-4366-87be-8c2d28481f8c None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:45.134249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39365fa3-0b0f-4720-a5b3-e00722a8538f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:45.134845 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39365fa3-0b0f-4720-a5b3-e00722a8538f service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:45.135117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39365fa3-0b0f-4720-a5b3-e00722a8538f service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:45.135413 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39365fa3-0b0f-4720-a5b3-e00722a8538f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:45.143778 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39365fa3-0b0f-4720-a5b3-e00722a8538f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:45.145351 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39365fa3-0b0f-4720-a5b3-e00722a8538f service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:45.155607 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 527/1048] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:46.084339 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b6dfa-d4d3-4fd5-8786-59d01aa3d5fb None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:46.084887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b6dfa-d4d3-4fd5-8786-59d01aa3d5fb None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:46.084985 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b6dfa-d4d3-4fd5-8786-59d01aa3d5fb None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:46.086267 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 522/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:46.091348 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa86dae-68a4-4f4f-b5e0-3758627ace0e None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:46.091893 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa86dae-68a4-4f4f-b5e0-3758627ace0e None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:46.091893 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa86dae-68a4-4f4f-b5e0-3758627ace0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:46.111437 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-5fa86dae-68a4-4f4f-b5e0-3758627ace0e None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:46.112650 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-5fa86dae-68a4-4f4f-b5e0-3758627ace0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:46.121237 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 528/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:39:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:46.275480 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b6dfa-d4d3-4fd5-8786-59d01aa3d5fb None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:46.291629 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b6dfa-d4d3-4fd5-8786-59d01aa3d5fb None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:46.297011 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c521e-5839-4feb-a200-5b94531470d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:46.297612 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c521e-5839-4feb-a200-5b94531470d3 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:46.297890 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c521e-5839-4feb-a200-5b94531470d3 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:46.298161 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c521e-5839-4feb-a200-5b94531470d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:46.307410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c521e-5839-4feb-a200-5b94531470d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:46.309007 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c521e-5839-4feb-a200-5b94531470d3 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:46.318473 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 523/1051] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:47.219474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de402cc8-addc-49aa-a7ca-2d17454aa131 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:47.220011 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de402cc8-addc-49aa-a7ca-2d17454aa131 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:47.220011 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de402cc8-addc-49aa-a7ca-2d17454aa131 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:47.221370 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 529/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:47.226543 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f452-7b23-4fea-8e2a-849bb4d152f0 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:47.226994 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f452-7b23-4fea-8e2a-849bb4d152f0 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:47.227094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f452-7b23-4fea-8e2a-849bb4d152f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:47.246657 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-8818f452-7b23-4fea-8e2a-849bb4d152f0 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:47.247894 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-8818f452-7b23-4fea-8e2a-849bb4d152f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:47.255657 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 524/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:39:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:47.421915 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de402cc8-addc-49aa-a7ca-2d17454aa131 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:47.435872 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de402cc8-addc-49aa-a7ca-2d17454aa131 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:47.440907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0221a3c-f6db-4031-b851-adcf41e4a819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:47.441512 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0221a3c-f6db-4031-b851-adcf41e4a819 service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:47.441788 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0221a3c-f6db-4031-b851-adcf41e4a819 service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:47.442060 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0221a3c-f6db-4031-b851-adcf41e4a819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:47.451293 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0221a3c-f6db-4031-b851-adcf41e4a819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:47.452875 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0221a3c-f6db-4031-b851-adcf41e4a819 service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:47.462410 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 530/1054] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:39:48.354512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccdabf-fc8c-4860-a51a-e08bf3603cbe None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:48.355104 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccdabf-fc8c-4860-a51a-e08bf3603cbe None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:48.355104 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccdabf-fc8c-4860-a51a-e08bf3603cbe None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:48.356394 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 525/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:48.361229 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5746d-5bbd-49be-b9fe-10bdc7b4a112 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:48.361647 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5746d-5bbd-49be-b9fe-10bdc7b4a112 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:48.361761 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5746d-5bbd-49be-b9fe-10bdc7b4a112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:48.380779 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-a4b5746d-5bbd-49be-b9fe-10bdc7b4a112 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:48.381980 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-a4b5746d-5bbd-49be-b9fe-10bdc7b4a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:48.390455 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 531/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:39:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:48.545246 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccdabf-fc8c-4860-a51a-e08bf3603cbe None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:48.559760 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccdabf-fc8c-4860-a51a-e08bf3603cbe None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:48.564751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcbd25-dd1c-48bf-8ffb-76e37b37f4a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:48.565360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcbd25-dd1c-48bf-8ffb-76e37b37f4a4 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:48.565689 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcbd25-dd1c-48bf-8ffb-76e37b37f4a4 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:48.565964 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcbd25-dd1c-48bf-8ffb-76e37b37f4a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:48.574788 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcbd25-dd1c-48bf-8ffb-76e37b37f4a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:48.576417 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcbd25-dd1c-48bf-8ffb-76e37b37f4a4 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:48.586693 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 526/1057] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:50.695480 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f113b-ff63-423a-90e1-929ee963989a None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:50.696009 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f113b-ff63-423a-90e1-929ee963989a None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:50.696009 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f113b-ff63-423a-90e1-929ee963989a None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:50.697285 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 532/1058] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:50.703325 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3eaf6-741d-4c08-b2b8-974bd5a590e3 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:50.703784 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3eaf6-741d-4c08-b2b8-974bd5a590e3 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:50.703896 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3eaf6-741d-4c08-b2b8-974bd5a590e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:50.722922 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-2bd3eaf6-741d-4c08-b2b8-974bd5a590e3 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:50.724173 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-2bd3eaf6-741d-4c08-b2b8-974bd5a590e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:50.732944 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 527/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:39:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:51.076568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f113b-ff63-423a-90e1-929ee963989a None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:51.087965 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f113b-ff63-423a-90e1-929ee963989a None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:51.091478 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79943ac0-606b-4222-812a-aeb02df07267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:51.092111 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79943ac0-606b-4222-812a-aeb02df07267 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:51.092391 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79943ac0-606b-4222-812a-aeb02df07267 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:51.092664 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79943ac0-606b-4222-812a-aeb02df07267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:51.101688 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79943ac0-606b-4222-812a-aeb02df07267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:51.103124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79943ac0-606b-4222-812a-aeb02df07267 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:51.112496 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 533/1060] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:53.485430 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2214c2-a15e-4f4d-a534-46c37e70d0b3 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:53.485951 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2214c2-a15e-4f4d-a534-46c37e70d0b3 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:53.486185 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2214c2-a15e-4f4d-a534-46c37e70d0b3 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:53.488217 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 528/1061] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:53.494270 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dc486-61e3-4d12-aa85-9e8016a9117f None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:53.494711 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dc486-61e3-4d12-aa85-9e8016a9117f None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:53.494823 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dc486-61e3-4d12-aa85-9e8016a9117f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:53.514748 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-e30dc486-61e3-4d12-aa85-9e8016a9117f None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:53.516012 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-e30dc486-61e3-4d12-aa85-9e8016a9117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:53.524121 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 534/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:39:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:53.861961 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2214c2-a15e-4f4d-a534-46c37e70d0b3 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:53.872821 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2214c2-a15e-4f4d-a534-46c37e70d0b3 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:53.876768 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0af686-aecc-4ec4-a396-a0b45d056902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:53.877392 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0af686-aecc-4ec4-a396-a0b45d056902 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:53.877667 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0af686-aecc-4ec4-a396-a0b45d056902 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:53.877935 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0af686-aecc-4ec4-a396-a0b45d056902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:53.887109 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0af686-aecc-4ec4-a396-a0b45d056902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:53.888555 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0af686-aecc-4ec4-a396-a0b45d056902 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:53.897877 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 529/1063] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:56.506479 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbac0a6-d611-4f41-9e12-0934771f113f None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:56.507023 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbac0a6-d611-4f41-9e12-0934771f113f None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:56.507023 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbac0a6-d611-4f41-9e12-0934771f113f None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:56.508428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 535/1064] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:56.514409 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8d10-0d55-4b7b-8a5f-dc754e5ab7d0 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:56.515571 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8d10-0d55-4b7b-8a5f-dc754e5ab7d0 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:56.515571 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8d10-0d55-4b7b-8a5f-dc754e5ab7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:56.537867 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-49fc8d10-0d55-4b7b-8a5f-dc754e5ab7d0 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:56.539912 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-49fc8d10-0d55-4b7b-8a5f-dc754e5ab7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:56.548508 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 530/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:39:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:56.887584 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbac0a6-d611-4f41-9e12-0934771f113f None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:56.898244 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbac0a6-d611-4f41-9e12-0934771f113f None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:56.902620 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3ebf4-1cfe-47d7-804c-86b681aba7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:56.903218 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3ebf4-1cfe-47d7-804c-86b681aba7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:56.903524 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3ebf4-1cfe-47d7-804c-86b681aba7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:56.903795 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3ebf4-1cfe-47d7-804c-86b681aba7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:56.913444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3ebf4-1cfe-47d7-804c-86b681aba7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:56.915492 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3ebf4-1cfe-47d7-804c-86b681aba7e0 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:56.925137 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 536/1066] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:59.231398 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886158f-e2a6-4333-a527-67993f2cc19f None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:59.231952 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886158f-e2a6-4333-a527-67993f2cc19f None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:59.231952 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886158f-e2a6-4333-a527-67993f2cc19f None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:59.233262 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 531/1067] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:59.238646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a461dc-5786-4828-adad-2e37688fccb4 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:59.239102 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a461dc-5786-4828-adad-2e37688fccb4 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:59.239210 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a461dc-5786-4828-adad-2e37688fccb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:59.259494 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-96a461dc-5786-4828-adad-2e37688fccb4 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:59.260747 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-96a461dc-5786-4828-adad-2e37688fccb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:59.269329 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 537/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:39:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:59.636480 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886158f-e2a6-4333-a527-67993f2cc19f None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:59.647543 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886158f-e2a6-4333-a527-67993f2cc19f None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:59.651103 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66324863-e851-4e7a-bda6-47876235d773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:59.651725 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66324863-e851-4e7a-bda6-47876235d773 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:59.651998 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66324863-e851-4e7a-bda6-47876235d773 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:59.652265 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66324863-e851-4e7a-bda6-47876235d773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:59.661536 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66324863-e851-4e7a-bda6-47876235d773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:59.662968 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66324863-e851-4e7a-bda6-47876235d773 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:59.673541 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 532/1069] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:01.996258 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9c79a-e253-4ff2-b16f-338bfd9217ea None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:01.997111 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9c79a-e253-4ff2-b16f-338bfd9217ea None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:01.997111 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9c79a-e253-4ff2-b16f-338bfd9217ea None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:01.998094 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 538/1070] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:40:02.003985 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d0624-97a1-4399-8211-686b911c0d51 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:02.004490 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d0624-97a1-4399-8211-686b911c0d51 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:02.004600 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d0624-97a1-4399-8211-686b911c0d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:02.028285 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-4d8d0624-97a1-4399-8211-686b911c0d51 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:02.029489 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-4d8d0624-97a1-4399-8211-686b911c0d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:02.037130 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 533/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:40:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:02.376735 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9c79a-e253-4ff2-b16f-338bfd9217ea None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:02.387407 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9c79a-e253-4ff2-b16f-338bfd9217ea None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:02.390866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcadc8e-57f9-49ab-9c26-97ba26976264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:02.391492 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcadc8e-57f9-49ab-9c26-97ba26976264 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:02.391766 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcadc8e-57f9-49ab-9c26-97ba26976264 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:02.392034 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcadc8e-57f9-49ab-9c26-97ba26976264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:02.401792 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcadc8e-57f9-49ab-9c26-97ba26976264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:02.403216 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcadc8e-57f9-49ab-9c26-97ba26976264 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:02.412765 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 539/1072] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:04.763726 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69faa8c-980e-479e-95a8-d99c0fc9ae6d None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:04.764401 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69faa8c-980e-479e-95a8-d99c0fc9ae6d None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:04.764401 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69faa8c-980e-479e-95a8-d99c0fc9ae6d None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:04.765960 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 534/1073] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:40:04.774740 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4eee-1697-467b-bcf0-938909580e16 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:04.775152 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4eee-1697-467b-bcf0-938909580e16 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:04.775322 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4eee-1697-467b-bcf0-938909580e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:04.783108 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=70 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:04.798492 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-52ec4eee-1697-467b-bcf0-938909580e16 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:04.799771 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-52ec4eee-1697-467b-bcf0-938909580e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:04.808550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 540/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:40:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:05.149425 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69faa8c-980e-479e-95a8-d99c0fc9ae6d None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:05.154925 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=64 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:05.161090 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69faa8c-980e-479e-95a8-d99c0fc9ae6d None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:05.165208 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d86c8-18c2-4019-9c07-0c0637d30998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:05.170667 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d86c8-18c2-4019-9c07-0c0637d30998 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:05.170667 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d86c8-18c2-4019-9c07-0c0637d30998 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:05.170667 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d86c8-18c2-4019-9c07-0c0637d30998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:05.176207 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d86c8-18c2-4019-9c07-0c0637d30998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:05.177703 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d86c8-18c2-4019-9c07-0c0637d30998 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:05.189755 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 535/1075] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:07.477633 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3f21e-1fd7-4eb6-82ed-b8453b8fc7cc None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:07.478174 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3f21e-1fd7-4eb6-82ed-b8453b8fc7cc None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:07.478174 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3f21e-1fd7-4eb6-82ed-b8453b8fc7cc None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:07.479536 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 541/1076] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:40:07.485758 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28040b91-ad4d-4432-929f-890fb7285d6f None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:07.486291 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28040b91-ad4d-4432-929f-890fb7285d6f None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:07.486407 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28040b91-ad4d-4432-929f-890fb7285d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:07.505160 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-28040b91-ad4d-4432-929f-890fb7285d6f None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:07.506381 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-28040b91-ad4d-4432-929f-890fb7285d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:07.514271 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 536/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:40:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:07.873580 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3f21e-1fd7-4eb6-82ed-b8453b8fc7cc None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:07.884781 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3f21e-1fd7-4eb6-82ed-b8453b8fc7cc None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:07.888301 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6961d6-1ec2-4aae-bb81-2ee7448d07a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:07.888892 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6961d6-1ec2-4aae-bb81-2ee7448d07a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:07.889163 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6961d6-1ec2-4aae-bb81-2ee7448d07a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:07.889456 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6961d6-1ec2-4aae-bb81-2ee7448d07a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:07.898223 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6961d6-1ec2-4aae-bb81-2ee7448d07a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:07.900245 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6961d6-1ec2-4aae-bb81-2ee7448d07a7 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:07.909549 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 542/1078] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:10.159802 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2b9fd-20ce-4362-8936-209fb8bf1e78 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:10.160347 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2b9fd-20ce-4362-8936-209fb8bf1e78 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:10.160347 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2b9fd-20ce-4362-8936-209fb8bf1e78 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:10.161694 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 537/1079] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:40:10.167757 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef14c7-118c-4458-a6f3-accf3b139cf6 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:10.168218 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef14c7-118c-4458-a6f3-accf3b139cf6 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:10.168326 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef14c7-118c-4458-a6f3-accf3b139cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:10.188009 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-68ef14c7-118c-4458-a6f3-accf3b139cf6 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:10.189209 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-68ef14c7-118c-4458-a6f3-accf3b139cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:10.196936 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 543/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:40:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:10.541927 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2b9fd-20ce-4362-8936-209fb8bf1e78 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:10.553029 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2b9fd-20ce-4362-8936-209fb8bf1e78 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:10.557374 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb2f1c-902e-40d9-8ab7-c5938e133ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:10.561139 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb2f1c-902e-40d9-8ab7-c5938e133ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:10.561139 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb2f1c-902e-40d9-8ab7-c5938e133ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:10.561139 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb2f1c-902e-40d9-8ab7-c5938e133ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:10.568171 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb2f1c-902e-40d9-8ab7-c5938e133ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:10.569631 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb2f1c-902e-40d9-8ab7-c5938e133ae6 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:10.579746 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 538/1081] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:12.815189 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae9e0-6356-4e50-a780-d77ffe6befba None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:12.815783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae9e0-6356-4e50-a780-d77ffe6befba None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:12.815783 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae9e0-6356-4e50-a780-d77ffe6befba None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:12.817106 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 544/1082] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:40:12.822410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623a659-cb52-4f1c-baf6-d0ca4860a3cd None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:12.822911 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623a659-cb52-4f1c-baf6-d0ca4860a3cd None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:12.823015 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623a659-cb52-4f1c-baf6-d0ca4860a3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:12.842485 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-5623a659-cb52-4f1c-baf6-d0ca4860a3cd None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:12.843725 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-5623a659-cb52-4f1c-baf6-d0ca4860a3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:12.851480 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 539/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:40:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:13.194913 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbae9e0-6356-4e50-a780-d77ffe6befba None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:13.206106 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbae9e0-6356-4e50-a780-d77ffe6befba None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:13.209558 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a3734-ef96-4716-8b41-9f64c197f3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:13.210150 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3734-ef96-4716-8b41-9f64c197f3ab service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:13.210428 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3734-ef96-4716-8b41-9f64c197f3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:13.210703 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3734-ef96-4716-8b41-9f64c197f3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:13.220204 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a3734-ef96-4716-8b41-9f64c197f3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:13.221640 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a3734-ef96-4716-8b41-9f64c197f3ab service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:13.231323 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 545/1084] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:15.463705 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f56b4-511b-492d-bd15-433c9b024cdf None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:15.464258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f56b4-511b-492d-bd15-433c9b024cdf None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:15.464258 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f56b4-511b-492d-bd15-433c9b024cdf None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:15.465504 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 540/1085] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:40:15.471500 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498ee67-2f61-4ae3-9f72-a67027bea644 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:15.472183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498ee67-2f61-4ae3-9f72-a67027bea644 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:15.472183 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498ee67-2f61-4ae3-9f72-a67027bea644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:15.493161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-4498ee67-2f61-4ae3-9f72-a67027bea644 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:15.495248 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-4498ee67-2f61-4ae3-9f72-a67027bea644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:15.503515 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 546/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:40:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:15.848792 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f56b4-511b-492d-bd15-433c9b024cdf None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:15.860079 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f56b4-511b-492d-bd15-433c9b024cdf None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:15.863537 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b11ca-6b33-42cc-b257-4ded1e86578a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:15.864125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b11ca-6b33-42cc-b257-4ded1e86578a service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:15.864402 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b11ca-6b33-42cc-b257-4ded1e86578a service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:15.864670 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b11ca-6b33-42cc-b257-4ded1e86578a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:15.873735 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b11ca-6b33-42cc-b257-4ded1e86578a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:15.875509 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b11ca-6b33-42cc-b257-4ded1e86578a service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:15.885646 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 541/1087] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:25.486895 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=20 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:25.881000 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=23 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:40.219812 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05555929-8f6b-4ecb-86a9-6dbda37477f1 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:40.220409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05555929-8f6b-4ecb-86a9-6dbda37477f1 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:40.220409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05555929-8f6b-4ecb-86a9-6dbda37477f1 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:40.221743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 547/1088] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:40:40.227880 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7749986-0bf6-474b-87c8-f3f4f57a1781 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:40.228354 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7749986-0bf6-474b-87c8-f3f4f57a1781 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:40.228461 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7749986-0bf6-474b-87c8-f3f4f57a1781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:40.247735 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-e7749986-0bf6-474b-87c8-f3f4f57a1781 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:40.248938 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-e7749986-0bf6-474b-87c8-f3f4f57a1781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:40.256642 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 542/1089] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:40:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:40.618615 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724dae2-804d-45dd-a541-5000e8e981cc None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:40.618896 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724dae2-804d-45dd-a541-5000e8e981cc None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:40.619171 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724dae2-804d-45dd-a541-5000e8e981cc None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:40.620527 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 548/1090] 10.222.0.18 () {54 vars in 967 bytes} [Tue Aug 23 16:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:40:40.625711 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163206a-7881-49c2-b57c-12a4923e5101 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:40.625992 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163206a-7881-49c2-b57c-12a4923e5101 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:40.626266 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163206a-7881-49c2-b57c-12a4923e5101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:40.645328 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-0163206a-7881-49c2-b57c-12a4923e5101 None None] MFA Rules not processed for user `a7ffdfa226444449817acbcccb0b1c10`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:40.646655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-0163206a-7881-49c2-b57c-12a4923e5101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:40.653680 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 543/1091] 10.222.0.18 () {58 vars in 1064 bytes} [Tue Aug 23 16:40:40 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:40.661149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724dae2-804d-45dd-a541-5000e8e981cc None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:40.672279 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724dae2-804d-45dd-a541-5000e8e981cc None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:40.676082 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8318c6-5711-489a-abdf-125c5c00a925 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ffdfa226444449817acbcccb0b1c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:40.676669 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8318c6-5711-489a-abdf-125c5c00a925 service glance] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:40.676953 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8318c6-5711-489a-abdf-125c5c00a925 service glance] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:40.677204 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8318c6-5711-489a-abdf-125c5c00a925 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:40.686121 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8318c6-5711-489a-abdf-125c5c00a925 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:40.687573 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8318c6-5711-489a-abdf-125c5c00a925 service glance] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:40.698156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 549/1092] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:42.971205 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6ce89-fc05-4fa1-b318-ecd546423a0b None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:42.971796 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6ce89-fc05-4fa1-b318-ecd546423a0b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:42.971796 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6ce89-fc05-4fa1-b318-ecd546423a0b None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:42.973124 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 544/1093] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:40:42.979048 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde25e4-d091-4c7d-a1a5-a90574e216b3 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:42.979568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde25e4-d091-4c7d-a1a5-a90574e216b3 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:42.979668 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde25e4-d091-4c7d-a1a5-a90574e216b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:43.000040 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-3cde25e4-d091-4c7d-a1a5-a90574e216b3 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:43.001311 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-3cde25e4-d091-4c7d-a1a5-a90574e216b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:43.009127 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 550/1094] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:40:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:43.346296 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6ce89-fc05-4fa1-b318-ecd546423a0b None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:43.358905 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6ce89-fc05-4fa1-b318-ecd546423a0b None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:43.363422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1bc04-7674-4048-8db0-96d6b5e4be98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:43.364024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1bc04-7674-4048-8db0-96d6b5e4be98 admin admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:43.364298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1bc04-7674-4048-8db0-96d6b5e4be98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:43.364700 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1bc04-7674-4048-8db0-96d6b5e4be98 admin admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:43.365340 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1bc04-7674-4048-8db0-96d6b5e4be98 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:43.367069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: WARNING py.warnings [None req-31b1bc04-7674-4048-8db0-96d6b5e4be98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:40:43.367069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: warnings.warn(msg) Aug 23 16:40:43.367069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: Aug 23 16:40:43.368767 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1bc04-7674-4048-8db0-96d6b5e4be98 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:43.387427 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 545/1095] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Aug 23 16:40:43 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:40:45.634923 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c6398-cbb9-445f-9f93-e59216f0eb7f None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:45.635513 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c6398-cbb9-445f-9f93-e59216f0eb7f None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:45.635650 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c6398-cbb9-445f-9f93-e59216f0eb7f None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:45.636933 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 551/1096] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:40:45.643089 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed26865-11d6-4d00-b7c4-3ffe3038291b None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:45.643606 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed26865-11d6-4d00-b7c4-3ffe3038291b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:45.643884 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed26865-11d6-4d00-b7c4-3ffe3038291b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:45.664677 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-6ed26865-11d6-4d00-b7c4-3ffe3038291b None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:45.666462 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-6ed26865-11d6-4d00-b7c4-3ffe3038291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:45.674257 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 546/1097] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:40:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:46.045449 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c6398-cbb9-445f-9f93-e59216f0eb7f None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:46.059402 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c6398-cbb9-445f-9f93-e59216f0eb7f None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:46.064513 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ba0c5-51da-4fc7-b41d-17eb3b19736b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:46.065148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ba0c5-51da-4fc7-b41d-17eb3b19736b service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:46.065412 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ba0c5-51da-4fc7-b41d-17eb3b19736b service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:46.065713 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ba0c5-51da-4fc7-b41d-17eb3b19736b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:46.074937 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ba0c5-51da-4fc7-b41d-17eb3b19736b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:46.076557 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ba0c5-51da-4fc7-b41d-17eb3b19736b service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:46.086220 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 552/1098] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:48.480218 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d4a98-22df-49a7-b245-ee5a8b604319 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:48.481074 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d4a98-22df-49a7-b245-ee5a8b604319 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:48.481074 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d4a98-22df-49a7-b245-ee5a8b604319 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:48.482666 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 547/1099] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:40:48.487987 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d186e3c-4a90-49fb-9177-63110ee24996 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:48.490282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d186e3c-4a90-49fb-9177-63110ee24996 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:48.490282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d186e3c-4a90-49fb-9177-63110ee24996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:48.507909 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-0d186e3c-4a90-49fb-9177-63110ee24996 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:48.509146 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-0d186e3c-4a90-49fb-9177-63110ee24996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:48.516876 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 553/1100] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:40:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:48.865598 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d4a98-22df-49a7-b245-ee5a8b604319 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:48.876843 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d4a98-22df-49a7-b245-ee5a8b604319 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:48.880318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeac12-5f20-4446-9d50-ad9c9ff2117e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:48.880903 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeac12-5f20-4446-9d50-ad9c9ff2117e service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:48.881176 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeac12-5f20-4446-9d50-ad9c9ff2117e service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:48.881444 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeac12-5f20-4446-9d50-ad9c9ff2117e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:48.890360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaeac12-5f20-4446-9d50-ad9c9ff2117e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:48.891831 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaeac12-5f20-4446-9d50-ad9c9ff2117e service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:48.901715 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 548/1101] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:51.160367 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa912-b794-4935-9d5e-787aa14c639c None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:51.160843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa912-b794-4935-9d5e-787aa14c639c None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:51.161028 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa912-b794-4935-9d5e-787aa14c639c None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:51.162251 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 554/1102] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:40:51.168426 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c513e09-8932-4ec6-bb15-080289165fc8 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:51.168876 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c513e09-8932-4ec6-bb15-080289165fc8 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:51.168976 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c513e09-8932-4ec6-bb15-080289165fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:51.187895 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-8c513e09-8932-4ec6-bb15-080289165fc8 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:51.189078 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-8c513e09-8932-4ec6-bb15-080289165fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:51.197362 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 549/1103] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:40:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:51.544179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aa912-b794-4935-9d5e-787aa14c639c None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:51.556637 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aa912-b794-4935-9d5e-787aa14c639c None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:51.560282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c4fdc-859c-490c-a7b7-a073c1d95f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:51.560899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c4fdc-859c-490c-a7b7-a073c1d95f74 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:51.561171 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c4fdc-859c-490c-a7b7-a073c1d95f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:51.561445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c4fdc-859c-490c-a7b7-a073c1d95f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:51.570888 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c4fdc-859c-490c-a7b7-a073c1d95f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:51.588971 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c4fdc-859c-490c-a7b7-a073c1d95f74 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:51.588971 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 555/1104] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:53.947349 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d44ab-9dbf-4d5d-8e71-b76fed25068b None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:53.947889 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d44ab-9dbf-4d5d-8e71-b76fed25068b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:53.947889 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d44ab-9dbf-4d5d-8e71-b76fed25068b None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:53.949218 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 550/1105] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:40:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:40:53.955868 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2729d6-e8a5-4081-b659-521f0467c4fb None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:53.956357 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2729d6-e8a5-4081-b659-521f0467c4fb None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:53.956465 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2729d6-e8a5-4081-b659-521f0467c4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:53.976421 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-8a2729d6-e8a5-4081-b659-521f0467c4fb None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:53.977634 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-8a2729d6-e8a5-4081-b659-521f0467c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:53.985496 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 556/1106] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:40:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:40:54.335245 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d44ab-9dbf-4d5d-8e71-b76fed25068b None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:54.346177 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d44ab-9dbf-4d5d-8e71-b76fed25068b None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:54.349772 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14f1c0-40e4-4f76-8d17-462aabdd9e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:54.350361 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14f1c0-40e4-4f76-8d17-462aabdd9e70 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:54.350634 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14f1c0-40e4-4f76-8d17-462aabdd9e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:54.350899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14f1c0-40e4-4f76-8d17-462aabdd9e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:54.361299 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14f1c0-40e4-4f76-8d17-462aabdd9e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:54.362967 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14f1c0-40e4-4f76-8d17-462aabdd9e70 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:54.376303 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 551/1107] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:57.273337 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0a24d-7abf-4bb3-97da-99039cb7f915 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:57.273897 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0a24d-7abf-4bb3-97da-99039cb7f915 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:57.273897 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0a24d-7abf-4bb3-97da-99039cb7f915 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:57.275839 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 557/1108] 10.222.0.18 () {54 vars in 927 bytes} [Tue Aug 23 16:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:40:57.281067 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b30ee-186b-458a-af30-a1842719e1c9 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:57.281520 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b30ee-186b-458a-af30-a1842719e1c9 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:57.281622 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b30ee-186b-458a-af30-a1842719e1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:57.300964 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-809b30ee-186b-458a-af30-a1842719e1c9 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:57.302195 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-809b30ee-186b-458a-af30-a1842719e1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:57.310094 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 552/1109] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Aug 23 16:40:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:57.661217 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0a24d-7abf-4bb3-97da-99039cb7f915 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:57.672748 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0a24d-7abf-4bb3-97da-99039cb7f915 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:57.676678 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc44b1-aabb-4fd8-b89a-9dfeef42ff17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:57.677282 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc44b1-aabb-4fd8-b89a-9dfeef42ff17 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:57.677553 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc44b1-aabb-4fd8-b89a-9dfeef42ff17 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:57.677823 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc44b1-aabb-4fd8-b89a-9dfeef42ff17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:57.687702 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc44b1-aabb-4fd8-b89a-9dfeef42ff17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:57.689165 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc44b1-aabb-4fd8-b89a-9dfeef42ff17 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:57.699161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 558/1110] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:07.295832 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=33 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:07.694696 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=33 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:21.555853 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c5eef-1f03-4b76-89b1-95713eb235b3 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:21.556478 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c5eef-1f03-4b76-89b1-95713eb235b3 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:21.556478 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c5eef-1f03-4b76-89b1-95713eb235b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:21.575570 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-8f0c5eef-1f03-4b76-89b1-95713eb235b3 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:21.577242 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-8f0c5eef-1f03-4b76-89b1-95713eb235b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:21.585307 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 553/1111] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:42:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:21.594099 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44660273-6811-4303-8ef5-f1f45a07f33f None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:21.594751 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44660273-6811-4303-8ef5-f1f45a07f33f None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:21.594751 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44660273-6811-4303-8ef5-f1f45a07f33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:21.614879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-44660273-6811-4303-8ef5-f1f45a07f33f None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:21.616138 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-44660273-6811-4303-8ef5-f1f45a07f33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:21.623970 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 559/1112] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:42:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:21.628596 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c5eef-1f03-4b76-89b1-95713eb235b3 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:21.638249 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c5eef-1f03-4b76-89b1-95713eb235b3 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:21.642794 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f241bf9-2b0a-4c9d-93ec-38ae573325ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:21.643410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f241bf9-2b0a-4c9d-93ec-38ae573325ed admin admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:21.643687 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f241bf9-2b0a-4c9d-93ec-38ae573325ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:21.643957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f241bf9-2b0a-4c9d-93ec-38ae573325ed admin admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:21.644599 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f241bf9-2b0a-4c9d-93ec-38ae573325ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:21.644895 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f241bf9-2b0a-4c9d-93ec-38ae573325ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:21.645890 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: WARNING py.warnings [None req-9f241bf9-2b0a-4c9d-93ec-38ae573325ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:42:21.645890 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: warnings.warn(msg) Aug 23 16:42:21.645890 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: Aug 23 16:42:21.646770 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f241bf9-2b0a-4c9d-93ec-38ae573325ed admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:21.659356 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 554/1113] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:42:21.672890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44660273-6811-4303-8ef5-f1f45a07f33f None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:21.682674 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44660273-6811-4303-8ef5-f1f45a07f33f None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:21.687603 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589ab77-7e45-4f95-815d-2f33e5e5aaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:21.688222 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589ab77-7e45-4f95-815d-2f33e5e5aaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:21.688497 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589ab77-7e45-4f95-815d-2f33e5e5aaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:21.688765 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589ab77-7e45-4f95-815d-2f33e5e5aaf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:21.689476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589ab77-7e45-4f95-815d-2f33e5e5aaf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:21.691389 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: WARNING py.warnings [None req-a589ab77-7e45-4f95-815d-2f33e5e5aaf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:42:21.691389 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: warnings.warn(msg) Aug 23 16:42:21.691389 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: Aug 23 16:42:21.693802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589ab77-7e45-4f95-815d-2f33e5e5aaf8 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:21.813214 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 560/1114] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:21 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:21.817455 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f241bf9-2b0a-4c9d-93ec-38ae573325ed admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:21.829366 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f241bf9-2b0a-4c9d-93ec-38ae573325ed admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:21.898731 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89c26b-ed0f-4199-a66d-4751779b3803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:21.898731 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89c26b-ed0f-4199-a66d-4751779b3803 admin admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:21.898731 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89c26b-ed0f-4199-a66d-4751779b3803 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:21.898731 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89c26b-ed0f-4199-a66d-4751779b3803 admin admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:21.899270 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89c26b-ed0f-4199-a66d-4751779b3803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:21.899270 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: WARNING py.warnings [None req-9b89c26b-ed0f-4199-a66d-4751779b3803 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:42:21.899270 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: warnings.warn(msg) Aug 23 16:42:21.899270 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: Aug 23 16:42:21.899777 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89c26b-ed0f-4199-a66d-4751779b3803 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:22.012047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 555/1115] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:21 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:22.017293 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589ab77-7e45-4f95-815d-2f33e5e5aaf8 admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:22.028118 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589ab77-7e45-4f95-815d-2f33e5e5aaf8 admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:22.033587 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12645d98-6bda-456a-9d6e-ca0d91d338db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:22.034178 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12645d98-6bda-456a-9d6e-ca0d91d338db admin admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:22.034452 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12645d98-6bda-456a-9d6e-ca0d91d338db admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:22.034720 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12645d98-6bda-456a-9d6e-ca0d91d338db admin admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:22.035394 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12645d98-6bda-456a-9d6e-ca0d91d338db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:22.036387 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: WARNING py.warnings [None req-12645d98-6bda-456a-9d6e-ca0d91d338db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:42:22.036387 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: warnings.warn(msg) Aug 23 16:42:22.036387 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: Aug 23 16:42:22.037423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12645d98-6bda-456a-9d6e-ca0d91d338db admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:22.051411 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 561/1116] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:22.056010 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89c26b-ed0f-4199-a66d-4751779b3803 admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:22.066069 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89c26b-ed0f-4199-a66d-4751779b3803 admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:22.070527 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061373ea-1d95-4c9c-9015-05942cae4a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:22.071106 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061373ea-1d95-4c9c-9015-05942cae4a00 admin admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:22.071412 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061373ea-1d95-4c9c-9015-05942cae4a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:22.071685 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061373ea-1d95-4c9c-9015-05942cae4a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:22.072399 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061373ea-1d95-4c9c-9015-05942cae4a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:22.073486 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: WARNING py.warnings [None req-061373ea-1d95-4c9c-9015-05942cae4a00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:42:22.073486 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: warnings.warn(msg) Aug 23 16:42:22.073486 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: Aug 23 16:42:22.074364 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061373ea-1d95-4c9c-9015-05942cae4a00 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:22.088159 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 556/1117] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:22.092571 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12645d98-6bda-456a-9d6e-ca0d91d338db admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:22.103021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12645d98-6bda-456a-9d6e-ca0d91d338db admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:22.107675 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e16d2-d40d-4d18-b5b3-fdfc810a9b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:22.108314 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e16d2-d40d-4d18-b5b3-fdfc810a9b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:22.108717 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e16d2-d40d-4d18-b5b3-fdfc810a9b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:22.108957 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e16d2-d40d-4d18-b5b3-fdfc810a9b06 admin admin] PATH_INFO: `/v3/projects/6cd2ff46a8e349f29167c1a1a8e4c452/users/771179e39ea6402a870b9383f5f975db/roles/4bc1625db2f14e779d8acb4d21d9d3f1` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:22.124001 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e16d2-d40d-4d18-b5b3-fdfc810a9b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd2ff46a8e349f29167c1a1a8e4c452, user_id=771179e39ea6402a870b9383f5f975db, role_id=4bc1625db2f14e779d8acb4d21d9d3f1)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:22.125072 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: WARNING py.warnings [None req-b42e16d2-d40d-4d18-b5b3-fdfc810a9b06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:42:22.125072 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: warnings.warn(msg) Aug 23 16:42:22.125072 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: Aug 23 16:42:22.127056 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e16d2-d40d-4d18-b5b3-fdfc810a9b06 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:22.194347 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 562/1118] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:22 2022] PUT /identity/v3/projects/6cd2ff46a8e349f29167c1a1a8e4c452/users/771179e39ea6402a870b9383f5f975db/roles/4bc1625db2f14e779d8acb4d21d9d3f1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:22.207255 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ae930-114a-45c0-a536-d5a5705cd338 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:22.207545 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ae930-114a-45c0-a536-d5a5705cd338 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:22.207820 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ae930-114a-45c0-a536-d5a5705cd338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:22.236755 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-742ae930-114a-45c0-a536-d5a5705cd338 None None] MFA Rules not processed for user `771179e39ea6402a870b9383f5f975db`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:22.237964 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-742ae930-114a-45c0-a536-d5a5705cd338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:22.301386 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 557/1119] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:42:22 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:22.315205 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf14a49-32a4-4aa7-afdb-6bb08a6ae205 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:22.315517 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf14a49-32a4-4aa7-afdb-6bb08a6ae205 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:22.315819 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf14a49-32a4-4aa7-afdb-6bb08a6ae205 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:22.317225 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 563/1120] 10.222.0.18 () {54 vars in 964 bytes} [Tue Aug 23 16:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:42:22.322088 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a988ba4-71bd-42b4-ac1c-0c3932f6b4c6 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:22.322371 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a988ba4-71bd-42b4-ac1c-0c3932f6b4c6 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:22.322643 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a988ba4-71bd-42b4-ac1c-0c3932f6b4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:22.342345 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-8a988ba4-71bd-42b4-ac1c-0c3932f6b4c6 None None] MFA Rules not processed for user `0e1b4d1056614edea1585de5e531ed96`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:22.343628 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-8a988ba4-71bd-42b4-ac1c-0c3932f6b4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:22.385508 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:22.393214 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 558/1121] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Aug 23 16:42:22 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:22.401160 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf14a49-32a4-4aa7-afdb-6bb08a6ae205 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:22.411983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf14a49-32a4-4aa7-afdb-6bb08a6ae205 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:22.415524 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7455f75-d676-4d22-a753-4c09c5937af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e1b4d1056614edea1585de5e531ed96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:22.416054 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7455f75-d676-4d22-a753-4c09c5937af6 service cinder] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:22.416333 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7455f75-d676-4d22-a753-4c09c5937af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:22.416598 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7455f75-d676-4d22-a753-4c09c5937af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:22.424807 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7455f75-d676-4d22-a753-4c09c5937af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:22.432285 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7455f75-d676-4d22-a753-4c09c5937af6 service cinder] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:22.435288 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 564/1122] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:22 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:22.473914 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f728c-72ed-4ef0-bce6-f3757f9b7ef0 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:22.474196 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f728c-72ed-4ef0-bce6-f3757f9b7ef0 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:22.474473 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f728c-72ed-4ef0-bce6-f3757f9b7ef0 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:22.475757 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 559/1123] 10.222.0.18 () {52 vars in 830 bytes} [Tue Aug 23 16:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:42:22.479211 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7455f75-d676-4d22-a753-4c09c5937af6 service cinder] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:22.544115 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7455f75-d676-4d22-a753-4c09c5937af6 service cinder] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:22.550481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:22.551140 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:22.551454 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:22.551728 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] PATH_INFO: `/v3/users/771179e39ea6402a870b9383f5f975db` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:22.552895 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] RBAC: Authorizing `identity:delete_user(user_id=771179e39ea6402a870b9383f5f975db)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:22.553907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: WARNING py.warnings [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:42:22.553907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: warnings.warn(msg) Aug 23 16:42:22.553907 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: Aug 23 16:42:22.555418 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:22.790122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771179e39ea6402a870b9383f5f975db'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:22.790762 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771179e39ea6402a870b9383f5f975db'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:22.871704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771179e39ea6402a870b9383f5f975db'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:22.896188 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771179e39ea6402a870b9383f5f975db'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:22.896947 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771179e39ea6402a870b9383f5f975db'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:22.907362 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:22.917857 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 565/1124] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:22 2022] DELETE /identity/v3/users/771179e39ea6402a870b9383f5f975db => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:22.922900 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f453b-8ebc-4cc4-ac8a-e81f62d97fd1 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:22.923418 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f453b-8ebc-4cc4-ac8a-e81f62d97fd1 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:22.923540 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f453b-8ebc-4cc4-ac8a-e81f62d97fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:22.942940 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-6f2f453b-8ebc-4cc4-ac8a-e81f62d97fd1 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:22.946196 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-6f2f453b-8ebc-4cc4-ac8a-e81f62d97fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:23.010025 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 560/1125] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:42:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:23.019803 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:23.021549 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:23.080818 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22881f-fd27-43d7-91f7-6a2efab7860c admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:23.084546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1f0d3-234f-4c95-b200-ee4d2cd02104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:23.085147 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1f0d3-234f-4c95-b200-ee4d2cd02104 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:23.085423 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1f0d3-234f-4c95-b200-ee4d2cd02104 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:23.085704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1f0d3-234f-4c95-b200-ee4d2cd02104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:23.095015 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1f0d3-234f-4c95-b200-ee4d2cd02104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:23.096463 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1f0d3-234f-4c95-b200-ee4d2cd02104 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:23.106371 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 566/1126] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:23.710096 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f453b-8ebc-4cc4-ac8a-e81f62d97fd1 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:23.711716 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-6f2f453b-8ebc-4cc4-ac8a-e81f62d97fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:23.725607 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f453b-8ebc-4cc4-ac8a-e81f62d97fd1 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:23.730414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2a900-a430-4ed2-bc53-15a79348f5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:23.731051 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2a900-a430-4ed2-bc53-15a79348f5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:23.731350 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2a900-a430-4ed2-bc53-15a79348f5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:23.731663 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2a900-a430-4ed2-bc53-15a79348f5e7 admin admin] PATH_INFO: `/v3/projects/6cd2ff46a8e349f29167c1a1a8e4c452` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:23.732770 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2a900-a430-4ed2-bc53-15a79348f5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd2ff46a8e349f29167c1a1a8e4c452)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:23.733805 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: WARNING py.warnings [None req-7bf2a900-a430-4ed2-bc53-15a79348f5e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:42:23.733805 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: warnings.warn(msg) Aug 23 16:42:23.733805 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: Aug 23 16:42:23.735086 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2a900-a430-4ed2-bc53-15a79348f5e7 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:23.873573 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-7bf2a900-a430-4ed2-bc53-15a79348f5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd2ff46a8e349f29167c1a1a8e4c452', 'request_id': 'req-7bf2a900-a430-4ed2-bc53-15a79348f5e7'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.879917 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-7bf2a900-a430-4ed2-bc53-15a79348f5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd2ff46a8e349f29167c1a1a8e4c452', 'request_id': 'req-7bf2a900-a430-4ed2-bc53-15a79348f5e7'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.893076 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-7bf2a900-a430-4ed2-bc53-15a79348f5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd2ff46a8e349f29167c1a1a8e4c452', 'request_id': 'req-7bf2a900-a430-4ed2-bc53-15a79348f5e7'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.974995 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-7bf2a900-a430-4ed2-bc53-15a79348f5e7 admin admin] The token cache is being invalidate because project 6cd2ff46a8e349f29167c1a1a8e4c452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:23.975767 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-7bf2a900-a430-4ed2-bc53-15a79348f5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.975949 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-7bf2a900-a430-4ed2-bc53-15a79348f5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.977439 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 561/1127] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:23 2022] DELETE /identity/v3/projects/6cd2ff46a8e349f29167c1a1a8e4c452 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:33.101621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=29 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:33.971732 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:48.370270 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612942b-90d2-431a-9453-58fba92bae13 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:48.370883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612942b-90d2-431a-9453-58fba92bae13 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:48.370883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612942b-90d2-431a-9453-58fba92bae13 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:48.372156 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 567/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:43:48.376918 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324f47b-5364-48ab-9e8b-c6d1622ce98f None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:48.377340 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324f47b-5364-48ab-9e8b-c6d1622ce98f None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:48.377473 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324f47b-5364-48ab-9e8b-c6d1622ce98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:48.398043 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-c324f47b-5364-48ab-9e8b-c6d1622ce98f None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:43:48.399943 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-c324f47b-5364-48ab-9e8b-c6d1622ce98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:48.458311 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 562/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:43:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:43:48.616732 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612942b-90d2-431a-9453-58fba92bae13 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:48.617906 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-8612942b-90d2-431a-9453-58fba92bae13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:48.689950 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612942b-90d2-431a-9453-58fba92bae13 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:48.697550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809a22f-11c2-47be-98f6-3133d92b282a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:48.697550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809a22f-11c2-47be-98f6-3133d92b282a service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:48.697550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809a22f-11c2-47be-98f6-3133d92b282a service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:48.697550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809a22f-11c2-47be-98f6-3133d92b282a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:48.704627 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809a22f-11c2-47be-98f6-3133d92b282a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:48.706219 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809a22f-11c2-47be-98f6-3133d92b282a service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:48.716149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 568/1130] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:43:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:43:49.546589 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90cbc-c23f-4dd7-a64e-0b9332d13044 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:49.547266 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90cbc-c23f-4dd7-a64e-0b9332d13044 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:49.547266 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90cbc-c23f-4dd7-a64e-0b9332d13044 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:49.548497 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 563/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:43:49.553558 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed05b7-d82f-4593-bab1-b83918556611 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:49.553999 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed05b7-d82f-4593-bab1-b83918556611 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:49.554102 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed05b7-d82f-4593-bab1-b83918556611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:49.574236 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-f5ed05b7-d82f-4593-bab1-b83918556611 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:43:49.575572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-f5ed05b7-d82f-4593-bab1-b83918556611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:49.583444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 569/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:43:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:43:49.746271 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b90cbc-c23f-4dd7-a64e-0b9332d13044 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:49.760041 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b90cbc-c23f-4dd7-a64e-0b9332d13044 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:49.764912 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bd7f8-2ec7-4d6f-8ac5-ddc8a4e39d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:49.765507 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bd7f8-2ec7-4d6f-8ac5-ddc8a4e39d43 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:49.765785 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bd7f8-2ec7-4d6f-8ac5-ddc8a4e39d43 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:49.766059 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bd7f8-2ec7-4d6f-8ac5-ddc8a4e39d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:49.775161 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bd7f8-2ec7-4d6f-8ac5-ddc8a4e39d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:49.776779 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bd7f8-2ec7-4d6f-8ac5-ddc8a4e39d43 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:49.786435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 564/1133] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:43:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:43:54.366764 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661658ca-96be-4fec-a1c6-c47028cb158e None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:54.367330 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661658ca-96be-4fec-a1c6-c47028cb158e None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:54.367454 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661658ca-96be-4fec-a1c6-c47028cb158e None None] PATH_INFO: `/v3` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:54.369246 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 570/1134] 10.222.0.45 () {54 vars in 925 bytes} [Tue Aug 23 16:43:54 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:43:54.375565 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99740ca2-817a-4183-b7b3-8db7018663bd None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:54.376019 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99740ca2-817a-4183-b7b3-8db7018663bd None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:54.376125 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99740ca2-817a-4183-b7b3-8db7018663bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:54.396183 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-99740ca2-817a-4183-b7b3-8db7018663bd None None] MFA Rules not processed for user `eef56a81a66744b2a3e468b7f182f9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:43:54.397371 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-99740ca2-817a-4183-b7b3-8db7018663bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:54.461438 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 565/1135] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Aug 23 16:43:54 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:43:59.569370 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=35 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:44:01.002153 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6f9c0-5be8-4392-8afb-25ad3b22a45a None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:01.002817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6f9c0-5be8-4392-8afb-25ad3b22a45a None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:01.002817 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6f9c0-5be8-4392-8afb-25ad3b22a45a None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:01.004078 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 571/1136] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:44:01.008957 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb919ae-389a-4c8d-ab17-c82f082ccbeb None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:01.013019 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb919ae-389a-4c8d-ab17-c82f082ccbeb None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:01.013019 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb919ae-389a-4c8d-ab17-c82f082ccbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:01.029280 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-bbb919ae-389a-4c8d-ab17-c82f082ccbeb None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:44:01.030505 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-bbb919ae-389a-4c8d-ab17-c82f082ccbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:44:01.038362 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 566/1137] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:44:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:44:01.199495 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6f9c0-5be8-4392-8afb-25ad3b22a45a None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:44:01.219484 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6f9c0-5be8-4392-8afb-25ad3b22a45a None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:44:01.224697 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de182b99-e782-4f53-aaf4-4d65acb558b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:44:01.225305 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de182b99-e782-4f53-aaf4-4d65acb558b1 service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:01.225592 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de182b99-e782-4f53-aaf4-4d65acb558b1 service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:01.225866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de182b99-e782-4f53-aaf4-4d65acb558b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:01.235197 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de182b99-e782-4f53-aaf4-4d65acb558b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:44:01.236828 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de182b99-e782-4f53-aaf4-4d65acb558b1 service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:44:01.246570 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 572/1138] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:44:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:44:02.064765 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6065df-58ca-4093-a43b-dd763716e9da None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:02.065341 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6065df-58ca-4093-a43b-dd763716e9da None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:02.065341 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6065df-58ca-4093-a43b-dd763716e9da None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:02.066652 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 567/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:44:02.072312 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031d5f5-a120-4e12-8804-0ba9b1c2fd16 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:02.073358 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031d5f5-a120-4e12-8804-0ba9b1c2fd16 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:02.073358 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031d5f5-a120-4e12-8804-0ba9b1c2fd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:02.091926 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-d031d5f5-a120-4e12-8804-0ba9b1c2fd16 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:44:02.093148 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-d031d5f5-a120-4e12-8804-0ba9b1c2fd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:44:02.101202 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 573/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:44:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:44:02.260368 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6065df-58ca-4093-a43b-dd763716e9da None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:44:02.273945 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6065df-58ca-4093-a43b-dd763716e9da None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:44:02.279089 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01997ab-d7f5-4709-addb-1a7ee60348d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:44:02.279716 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01997ab-d7f5-4709-addb-1a7ee60348d6 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:02.279988 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01997ab-d7f5-4709-addb-1a7ee60348d6 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:02.280254 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01997ab-d7f5-4709-addb-1a7ee60348d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:02.288435 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01997ab-d7f5-4709-addb-1a7ee60348d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:44:02.290780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01997ab-d7f5-4709-addb-1a7ee60348d6 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:44:02.300747 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 568/1141] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:44:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:44:05.383467 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05403c-143d-4767-b095-4a4b28952a30 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:05.384115 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05403c-143d-4767-b095-4a4b28952a30 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:05.384115 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05403c-143d-4767-b095-4a4b28952a30 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:05.385320 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 574/1142] 10.222.0.18 () {54 vars in 961 bytes} [Tue Aug 23 16:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:44:05.390341 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bbcfd-d9c0-4d7f-adfb-1d1ec9407c7c None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:05.390751 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bbcfd-d9c0-4d7f-adfb-1d1ec9407c7c None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:05.390881 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bbcfd-d9c0-4d7f-adfb-1d1ec9407c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:05.410921 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-0b1bbcfd-d9c0-4d7f-adfb-1d1ec9407c7c None None] MFA Rules not processed for user `eef56a81a66744b2a3e468b7f182f9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:44:05.412213 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-0b1bbcfd-d9c0-4d7f-adfb-1d1ec9407c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:44:05.421718 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 569/1143] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Aug 23 16:44:05 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:44:05.429214 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05403c-143d-4767-b095-4a4b28952a30 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:44:05.443932 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05403c-143d-4767-b095-4a4b28952a30 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:44:05.448886 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de250f46-49e9-4bd3-a7b1-54ba9a06a206 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef56a81a66744b2a3e468b7f182f9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:44:05.449478 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250f46-49e9-4bd3-a7b1-54ba9a06a206 service placement] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:05.449746 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250f46-49e9-4bd3-a7b1-54ba9a06a206 service placement] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:05.450016 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250f46-49e9-4bd3-a7b1-54ba9a06a206 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:05.458497 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de250f46-49e9-4bd3-a7b1-54ba9a06a206 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:44:05.460109 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de250f46-49e9-4bd3-a7b1-54ba9a06a206 service placement] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:44:05.469506 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 575/1144] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:44:05 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:44:13.488660 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2ea45-75d2-4f0e-b4bb-5fa6590a94dd None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:13.489224 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2ea45-75d2-4f0e-b4bb-5fa6590a94dd None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:13.489224 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2ea45-75d2-4f0e-b4bb-5fa6590a94dd None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:13.490536 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 570/1145] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:44:13.495450 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a738a53-455d-4e9e-83a6-c1dde2805c9d None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:13.495889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a738a53-455d-4e9e-83a6-c1dde2805c9d None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:13.496031 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a738a53-455d-4e9e-83a6-c1dde2805c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:13.515551 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-4a738a53-455d-4e9e-83a6-c1dde2805c9d None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:44:13.516663 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-4a738a53-455d-4e9e-83a6-c1dde2805c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:44:13.524352 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 576/1146] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:44:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:44:13.684011 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2ea45-75d2-4f0e-b4bb-5fa6590a94dd None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:44:13.697795 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2ea45-75d2-4f0e-b4bb-5fa6590a94dd None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:44:13.703260 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767ea34-31ad-4cff-aa1c-68d5b1276608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:44:13.707360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ea34-31ad-4cff-aa1c-68d5b1276608 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:13.707360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ea34-31ad-4cff-aa1c-68d5b1276608 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:13.707360 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ea34-31ad-4cff-aa1c-68d5b1276608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:13.712559 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767ea34-31ad-4cff-aa1c-68d5b1276608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:44:13.714134 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767ea34-31ad-4cff-aa1c-68d5b1276608 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:44:13.724115 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 571/1147] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:44:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:44:14.566571 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67c1fa-bfd8-481b-abd0-6b27b9a5130b None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:14.567121 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67c1fa-bfd8-481b-abd0-6b27b9a5130b None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:14.567121 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67c1fa-bfd8-481b-abd0-6b27b9a5130b None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:14.578580 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 577/1148] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:44:14.578708 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57abf0-69fd-413c-9dde-f0a323c48bf8 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:14.578708 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57abf0-69fd-413c-9dde-f0a323c48bf8 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:14.578708 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57abf0-69fd-413c-9dde-f0a323c48bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:14.582123 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=81 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:44:14.594602 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-cd57abf0-69fd-413c-9dde-f0a323c48bf8 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:44:14.595823 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-cd57abf0-69fd-413c-9dde-f0a323c48bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:44:14.603495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 572/1149] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:44:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:44:14.759699 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67c1fa-bfd8-481b-abd0-6b27b9a5130b None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:44:14.781862 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67c1fa-bfd8-481b-abd0-6b27b9a5130b None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:44:14.786765 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c5a36-428a-467e-9293-591067f037af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:44:14.787394 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5a36-428a-467e-9293-591067f037af service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:14.787674 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5a36-428a-467e-9293-591067f037af service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:14.787944 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5a36-428a-467e-9293-591067f037af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:14.796835 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c5a36-428a-467e-9293-591067f037af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:44:14.798408 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c5a36-428a-467e-9293-591067f037af service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:44:14.807523 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 578/1150] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:44:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:44:18.839619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c0b7e-17ce-4ff2-93fb-b6123a6da40e None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:18.840209 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c0b7e-17ce-4ff2-93fb-b6123a6da40e None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:18.840209 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c0b7e-17ce-4ff2-93fb-b6123a6da40e None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:18.841501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 573/1151] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:44:18.846859 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf11552-afb8-4c9d-beb0-06124dd48509 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:18.849316 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf11552-afb8-4c9d-beb0-06124dd48509 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:18.849316 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf11552-afb8-4c9d-beb0-06124dd48509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:18.866836 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-fbf11552-afb8-4c9d-beb0-06124dd48509 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:44:18.868051 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-fbf11552-afb8-4c9d-beb0-06124dd48509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:44:18.876463 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 579/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:44:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:44:19.219217 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c0b7e-17ce-4ff2-93fb-b6123a6da40e None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:44:19.220984 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-d19c0b7e-17ce-4ff2-93fb-b6123a6da40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:44:19.282052 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c0b7e-17ce-4ff2-93fb-b6123a6da40e None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:44:19.285748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c56cc3-f50c-4ac2-bc58-384c9243b3a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:44:19.286359 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c56cc3-f50c-4ac2-bc58-384c9243b3a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:19.286636 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c56cc3-f50c-4ac2-bc58-384c9243b3a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:19.286908 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c56cc3-f50c-4ac2-bc58-384c9243b3a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:19.296710 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c56cc3-f50c-4ac2-bc58-384c9243b3a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:44:19.298164 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c56cc3-f50c-4ac2-bc58-384c9243b3a0 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:44:19.307677 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 574/1153] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:44:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:44:21.518976 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912d990-7948-4d15-8d50-7caeabeffec6 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:21.519564 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912d990-7948-4d15-8d50-7caeabeffec6 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:21.519564 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912d990-7948-4d15-8d50-7caeabeffec6 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:21.520816 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 580/1154] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:44:21.526008 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39791-95f5-4e9a-9ae4-f87b51c0044d None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:21.526410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39791-95f5-4e9a-9ae4-f87b51c0044d None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:21.526558 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39791-95f5-4e9a-9ae4-f87b51c0044d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:21.546729 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-e1a39791-95f5-4e9a-9ae4-f87b51c0044d None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:44:21.547963 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-e1a39791-95f5-4e9a-9ae4-f87b51c0044d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:44:21.555687 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 575/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:44:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:44:21.898960 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912d990-7948-4d15-8d50-7caeabeffec6 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:44:21.902006 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-1912d990-7948-4d15-8d50-7caeabeffec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:44:21.914431 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912d990-7948-4d15-8d50-7caeabeffec6 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:44:21.918192 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a87ac-c37f-43a9-8e27-c33dbdbe4906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:44:21.918793 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a87ac-c37f-43a9-8e27-c33dbdbe4906 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:21.919072 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a87ac-c37f-43a9-8e27-c33dbdbe4906 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:21.919390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a87ac-c37f-43a9-8e27-c33dbdbe4906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:21.928558 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a87ac-c37f-43a9-8e27-c33dbdbe4906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:44:21.929974 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a87ac-c37f-43a9-8e27-c33dbdbe4906 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:44:21.939759 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 581/1156] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:44:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:44:25.758942 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2447b-82c3-44be-8b6e-bd555f083c1b None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:25.759544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2447b-82c3-44be-8b6e-bd555f083c1b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:25.759640 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2447b-82c3-44be-8b6e-bd555f083c1b None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:25.761030 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 576/1157] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:44:25.766332 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f9176-9ce7-47e5-a637-de5d837c526c None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:25.766747 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f9176-9ce7-47e5-a637-de5d837c526c None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:25.766885 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f9176-9ce7-47e5-a637-de5d837c526c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:25.786541 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-9b0f9176-9ce7-47e5-a637-de5d837c526c None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:44:25.793444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-9b0f9176-9ce7-47e5-a637-de5d837c526c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:44:25.796136 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 582/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:44:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:44:26.396728 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2447b-82c3-44be-8b6e-bd555f083c1b None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:44:26.398401 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-77c2447b-82c3-44be-8b6e-bd555f083c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:44:26.455968 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2447b-82c3-44be-8b6e-bd555f083c1b None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:44:26.459410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce9cc6-3cc9-4dcc-ade1-0ea28d0d4f93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e1b4d1056614edea1585de5e531ed96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:44:26.460001 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce9cc6-3cc9-4dcc-ade1-0ea28d0d4f93 service cinder] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:26.460275 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce9cc6-3cc9-4dcc-ade1-0ea28d0d4f93 service cinder] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:26.460543 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce9cc6-3cc9-4dcc-ade1-0ea28d0d4f93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:26.469203 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce9cc6-3cc9-4dcc-ade1-0ea28d0d4f93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:44:26.470614 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce9cc6-3cc9-4dcc-ade1-0ea28d0d4f93 service cinder] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:44:26.479749 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 577/1159] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:44:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:44:28.694882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef57f0-7049-4ed4-91e4-3f66194e5c67 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:28.695496 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef57f0-7049-4ed4-91e4-3f66194e5c67 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:28.695613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef57f0-7049-4ed4-91e4-3f66194e5c67 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:28.696866 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 583/1160] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:44:28.702719 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf6c0b-1ee8-41d8-a2fb-be6609190a9e None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:28.703194 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf6c0b-1ee8-41d8-a2fb-be6609190a9e None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:28.703318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf6c0b-1ee8-41d8-a2fb-be6609190a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:28.723988 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-2bbf6c0b-1ee8-41d8-a2fb-be6609190a9e None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:44:28.725195 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-2bbf6c0b-1ee8-41d8-a2fb-be6609190a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:44:28.733033 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 578/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:44:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:44:29.305567 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef57f0-7049-4ed4-91e4-3f66194e5c67 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:44:29.307203 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-e5ef57f0-7049-4ed4-91e4-3f66194e5c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:44:29.321704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef57f0-7049-4ed4-91e4-3f66194e5c67 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:44:29.324557 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30946e9-4168-4f8a-b35d-153974b0d480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e1b4d1056614edea1585de5e531ed96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:44:29.325142 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30946e9-4168-4f8a-b35d-153974b0d480 service cinder] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:44:29.325436 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30946e9-4168-4f8a-b35d-153974b0d480 service cinder] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:44:29.325703 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30946e9-4168-4f8a-b35d-153974b0d480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:44:29.334766 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30946e9-4168-4f8a-b35d-153974b0d480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:44:29.336197 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30946e9-4168-4f8a-b35d-153974b0d480 service cinder] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:44:29.345369 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 584/1162] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:44:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:44:38.718298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=60 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:44:39.341339 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=42 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:45.688483 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731602f2-dc28-4ad7-ba69-22090b02b60b None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:45.689144 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731602f2-dc28-4ad7-ba69-22090b02b60b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:45.689144 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731602f2-dc28-4ad7-ba69-22090b02b60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:45.692344 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562af7d-fb99-40e4-9d7b-3b4b1b1cc693 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:45.692878 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562af7d-fb99-40e4-9d7b-3b4b1b1cc693 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:45.692878 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562af7d-fb99-40e4-9d7b-3b4b1b1cc693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:45.709300 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-731602f2-dc28-4ad7-ba69-22090b02b60b None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:45:45.710515 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-731602f2-dc28-4ad7-ba69-22090b02b60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:45.718882 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-d562af7d-fb99-40e4-9d7b-3b4b1b1cc693 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:45:45.719117 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 579/1163] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:45:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:45:45.720128 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-d562af7d-fb99-40e4-9d7b-3b4b1b1cc693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:45.727269 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a9484-f47c-40bd-8727-96aafc120c71 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:45.728134 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a9484-f47c-40bd-8727-96aafc120c71 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:45.728134 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a9484-f47c-40bd-8727-96aafc120c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:45.728331 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 585/1164] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:45:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:45:45.736077 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe50c3-57ec-434a-9d89-2978b26f9b3e None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:45.736356 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe50c3-57ec-434a-9d89-2978b26f9b3e None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:45.736629 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe50c3-57ec-434a-9d89-2978b26f9b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:45.748827 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-623a9484-f47c-40bd-8727-96aafc120c71 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:45:45.750200 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-623a9484-f47c-40bd-8727-96aafc120c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:45.756715 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-dabe50c3-57ec-434a-9d89-2978b26f9b3e None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:45:45.757884 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-dabe50c3-57ec-434a-9d89-2978b26f9b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:45.759043 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 580/1165] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:45:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:45:45.763422 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a9484-f47c-40bd-8727-96aafc120c71 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:45.765557 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 586/1166] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:45:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:45:45.772105 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe50c3-57ec-434a-9d89-2978b26f9b3e None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:45.773844 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a9484-f47c-40bd-8727-96aafc120c71 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:45.778510 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c84a76-c4f5-44af-8ea5-be66a0985d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:45.779115 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c84a76-c4f5-44af-8ea5-be66a0985d76 admin admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:45.779628 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c84a76-c4f5-44af-8ea5-be66a0985d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:45.779865 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c84a76-c4f5-44af-8ea5-be66a0985d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:45.780513 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c84a76-c4f5-44af-8ea5-be66a0985d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:45:45.780822 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c84a76-c4f5-44af-8ea5-be66a0985d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:45.781335 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe50c3-57ec-434a-9d89-2978b26f9b3e None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:45.782423 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c84a76-c4f5-44af-8ea5-be66a0985d76 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:45.785988 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3196918-7463-4d05-9cbd-a58b8301aa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:45.786658 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3196918-7463-4d05-9cbd-a58b8301aa31 admin admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:45.786859 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3196918-7463-4d05-9cbd-a58b8301aa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:45.787136 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3196918-7463-4d05-9cbd-a58b8301aa31 admin admin] PATH_INFO: `/v3/domains` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:45.787811 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3196918-7463-4d05-9cbd-a58b8301aa31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88349) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:45:45.788119 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3196918-7463-4d05-9cbd-a58b8301aa31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:45.789371 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: WARNING py.warnings [None req-e3196918-7463-4d05-9cbd-a58b8301aa31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:45:45.789371 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: warnings.warn(msg) Aug 23 16:45:45.789371 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: Aug 23 16:45:45.790001 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3196918-7463-4d05-9cbd-a58b8301aa31 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:45.797898 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 581/1167] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Aug 23 16:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:45:45.809775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 587/1168] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Aug 23 16:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:45:45.810635 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c84a76-c4f5-44af-8ea5-be66a0985d76 admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:45.812406 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3196918-7463-4d05-9cbd-a58b8301aa31 admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:45.821705 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c84a76-c4f5-44af-8ea5-be66a0985d76 admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:45.822654 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3196918-7463-4d05-9cbd-a58b8301aa31 admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:45.826403 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50598-a3dc-49be-adaa-4dae6f79f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:45.826999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50598-a3dc-49be-adaa-4dae6f79f106 admin admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:45.827332 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50598-a3dc-49be-adaa-4dae6f79f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:45.827467 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6c7bd-ccd9-4af7-bbb0-54e649301437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:45.827692 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50598-a3dc-49be-adaa-4dae6f79f106 admin admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:45.827926 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c7bd-ccd9-4af7-bbb0-54e649301437 admin admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:45.828205 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c7bd-ccd9-4af7-bbb0-54e649301437 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:45.828313 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c50598-a3dc-49be-adaa-4dae6f79f106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:45.828481 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c7bd-ccd9-4af7-bbb0-54e649301437 admin admin] PATH_INFO: `/v3/projects` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:45.829090 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6c7bd-ccd9-4af7-bbb0-54e649301437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:45.829236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: WARNING py.warnings [None req-44c50598-a3dc-49be-adaa-4dae6f79f106 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:45:45.829236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: warnings.warn(msg) Aug 23 16:45:45.829236 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: Aug 23 16:45:45.830410 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c50598-a3dc-49be-adaa-4dae6f79f106 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:45.830971 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6c7bd-ccd9-4af7-bbb0-54e649301437 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:45.920966 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 588/1169] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Aug 23 16:45:45 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:45:45.925026 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6c7bd-ccd9-4af7-bbb0-54e649301437 admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:45.951157 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 582/1170] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Aug 23 16:45:45 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:45:45.954902 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50598-a3dc-49be-adaa-4dae6f79f106 admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:45.987196 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6c7bd-ccd9-4af7-bbb0-54e649301437 admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:46.018839 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50598-a3dc-49be-adaa-4dae6f79f106 admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:46.024742 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d0c45-4f15-4c3c-b76b-b27666aa844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:46.024956 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d0c45-4f15-4c3c-b76b-b27666aa844a admin admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:46.025264 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d0c45-4f15-4c3c-b76b-b27666aa844a admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:46.025600 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d0c45-4f15-4c3c-b76b-b27666aa844a admin admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:46.026218 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d0c45-4f15-4c3c-b76b-b27666aa844a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:46.028204 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d0c45-4f15-4c3c-b76b-b27666aa844a admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:46.046100 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd654ae-bc0e-442e-9b30-5e73822d9aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:46.050158 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd654ae-bc0e-442e-9b30-5e73822d9aad admin admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:46.050158 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd654ae-bc0e-442e-9b30-5e73822d9aad admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:46.050158 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd654ae-bc0e-442e-9b30-5e73822d9aad admin admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:46.050158 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd654ae-bc0e-442e-9b30-5e73822d9aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:46.050158 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: WARNING py.warnings [None req-5cd654ae-bc0e-442e-9b30-5e73822d9aad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:45:46.050158 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: warnings.warn(msg) Aug 23 16:45:46.050158 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: Aug 23 16:45:46.050842 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd654ae-bc0e-442e-9b30-5e73822d9aad admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:46.138808 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 583/1171] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Aug 23 16:45:45 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:45:46.142666 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d0c45-4f15-4c3c-b76b-b27666aa844a admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:46.152007 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d0c45-4f15-4c3c-b76b-b27666aa844a admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:46.157019 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acb85-6cfd-47fe-9f88-a26688f76efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:46.157598 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acb85-6cfd-47fe-9f88-a26688f76efc admin admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:46.157872 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acb85-6cfd-47fe-9f88-a26688f76efc admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:46.158143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acb85-6cfd-47fe-9f88-a26688f76efc admin admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:46.158793 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597acb85-6cfd-47fe-9f88-a26688f76efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:46.160953 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597acb85-6cfd-47fe-9f88-a26688f76efc admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:46.168017 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 589/1172] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Aug 23 16:45:45 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:45:46.172363 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 584/1173] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Aug 23 16:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:45:46.176908 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acb85-6cfd-47fe-9f88-a26688f76efc admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:46.177051 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd654ae-bc0e-442e-9b30-5e73822d9aad admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:46.187100 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acb85-6cfd-47fe-9f88-a26688f76efc admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:46.187292 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd654ae-bc0e-442e-9b30-5e73822d9aad admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:46.192603 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c70f3-6a6a-40ac-a0ed-344abaa4c7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:46.192738 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96b8e7-3f19-45e7-9bb6-fef91809cf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:46.193197 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c70f3-6a6a-40ac-a0ed-344abaa4c7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:46.193309 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96b8e7-3f19-45e7-9bb6-fef91809cf04 admin admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:46.193475 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c70f3-6a6a-40ac-a0ed-344abaa4c7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:46.193584 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96b8e7-3f19-45e7-9bb6-fef91809cf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:46.193748 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c70f3-6a6a-40ac-a0ed-344abaa4c7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:46.193937 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96b8e7-3f19-45e7-9bb6-fef91809cf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:46.194433 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96b8e7-3f19-45e7-9bb6-fef91809cf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:46.194528 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c70f3-6a6a-40ac-a0ed-344abaa4c7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:46.196040 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96b8e7-3f19-45e7-9bb6-fef91809cf04 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:46.196151 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c70f3-6a6a-40ac-a0ed-344abaa4c7d6 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:46.222204 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 585/1174] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Aug 23 16:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:45:46.222576 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 590/1175] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Aug 23 16:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:45:46.224959 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96b8e7-3f19-45e7-9bb6-fef91809cf04 admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:46.225149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c70f3-6a6a-40ac-a0ed-344abaa4c7d6 admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:46.235091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c70f3-6a6a-40ac-a0ed-344abaa4c7d6 admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:46.235600 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96b8e7-3f19-45e7-9bb6-fef91809cf04 admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:46.239872 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7347c-f0ef-454a-85e2-66636f700b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:46.240295 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e463c-60c4-4e77-84c0-7bdbdef979cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:46.240521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7347c-f0ef-454a-85e2-66636f700b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:46.240797 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7347c-f0ef-454a-85e2-66636f700b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:46.240912 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e463c-60c4-4e77-84c0-7bdbdef979cb admin admin] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:46.241070 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7347c-f0ef-454a-85e2-66636f700b91 admin admin] PATH_INFO: `/v3/projects/39aae0b85d144e1090b7a5de6b23be8f/users/c0672efa012d46379c195c0460a0002f/roles/4bc1625db2f14e779d8acb4d21d9d3f1` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:46.241176 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e463c-60c4-4e77-84c0-7bdbdef979cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:46.241418 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e463c-60c4-4e77-84c0-7bdbdef979cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:46.242053 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e463c-60c4-4e77-84c0-7bdbdef979cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:46.243693 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e463c-60c4-4e77-84c0-7bdbdef979cb admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:46.254330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 586/1176] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Aug 23 16:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:45:46.258379 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e463c-60c4-4e77-84c0-7bdbdef979cb admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:46.259570 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7347c-f0ef-454a-85e2-66636f700b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39aae0b85d144e1090b7a5de6b23be8f, user_id=c0672efa012d46379c195c0460a0002f, role_id=4bc1625db2f14e779d8acb4d21d9d3f1)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:46.262251 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7347c-f0ef-454a-85e2-66636f700b91 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:46.268174 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e463c-60c4-4e77-84c0-7bdbdef979cb admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:46.273416 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a6284-e75d-4eaa-a06c-046ca9fd611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:46.276818 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a6284-e75d-4eaa-a06c-046ca9fd611e admin admin] REQUEST_METHOD: `PUT` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:46.276818 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a6284-e75d-4eaa-a06c-046ca9fd611e admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:46.276818 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a6284-e75d-4eaa-a06c-046ca9fd611e admin admin] PATH_INFO: `/v3/projects/b46ead312aa541f0a3e7e209f23b60cf/users/98771733cc4b495bb515bccf10d7e9b5/roles/4bc1625db2f14e779d8acb4d21d9d3f1` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:46.289001 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a6284-e75d-4eaa-a06c-046ca9fd611e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46ead312aa541f0a3e7e209f23b60cf, user_id=98771733cc4b495bb515bccf10d7e9b5, role_id=4bc1625db2f14e779d8acb4d21d9d3f1)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:46.290024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: WARNING py.warnings [None req-cf6a6284-e75d-4eaa-a06c-046ca9fd611e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:45:46.290024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: warnings.warn(msg) Aug 23 16:45:46.290024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: Aug 23 16:45:46.292022 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a6284-e75d-4eaa-a06c-046ca9fd611e admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:46.367659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 591/1177] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Aug 23 16:45:46 2022] PUT /identity/v3/projects/39aae0b85d144e1090b7a5de6b23be8f/users/c0672efa012d46379c195c0460a0002f/roles/4bc1625db2f14e779d8acb4d21d9d3f1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:45:46.372676 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd80a0-fbca-4385-a88a-830c73285ac8 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:46.372958 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd80a0-fbca-4385-a88a-830c73285ac8 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:46.373240 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd80a0-fbca-4385-a88a-830c73285ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:46.384462 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 587/1178] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Aug 23 16:45:46 2022] PUT /identity/v3/projects/b46ead312aa541f0a3e7e209f23b60cf/users/98771733cc4b495bb515bccf10d7e9b5/roles/4bc1625db2f14e779d8acb4d21d9d3f1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:45:46.389429 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ddff-2340-499a-8e3a-800b626cdbb1 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:46.389901 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ddff-2340-499a-8e3a-800b626cdbb1 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:46.390187 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ddff-2340-499a-8e3a-800b626cdbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:46.392416 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-06bd80a0-fbca-4385-a88a-830c73285ac8 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:45:46.397205 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-06bd80a0-fbca-4385-a88a-830c73285ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:46.401857 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:46.408772 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-b750ddff-2340-499a-8e3a-800b626cdbb1 None None] MFA Rules not processed for user `b441ea8946b74edd833bbf63322f9350`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:45:46.410033 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-b750ddff-2340-499a-8e3a-800b626cdbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:46.450313 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:46.452999 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 592/1179] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:45:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:45:46.463415 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd80a0-fbca-4385-a88a-830c73285ac8 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:46.469396 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 588/1180] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:45:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:45:46.478881 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ddff-2340-499a-8e3a-800b626cdbb1 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:46.517044 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd80a0-fbca-4385-a88a-830c73285ac8 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:46.520836 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480f9b9-3e51-4d33-b128-55c80be18bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:46.521440 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480f9b9-3e51-4d33-b128-55c80be18bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:46.521733 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480f9b9-3e51-4d33-b128-55c80be18bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:46.521988 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480f9b9-3e51-4d33-b128-55c80be18bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:46.531055 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480f9b9-3e51-4d33-b128-55c80be18bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:46.532534 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ddff-2340-499a-8e3a-800b626cdbb1 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:46.532671 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480f9b9-3e51-4d33-b128-55c80be18bc1 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:46.536164 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56b8d4-a198-4c80-a643-4ec1d63cdb0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:46.536782 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56b8d4-a198-4c80-a643-4ec1d63cdb0d service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:46.537065 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56b8d4-a198-4c80-a643-4ec1d63cdb0d service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:46.537336 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56b8d4-a198-4c80-a643-4ec1d63cdb0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:46.543262 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 593/1181] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:45:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:45:46.546362 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56b8d4-a198-4c80-a643-4ec1d63cdb0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:46.551112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56b8d4-a198-4c80-a643-4ec1d63cdb0d service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:46.557906 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 589/1182] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:45:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:45:52.941969 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4681a-4307-46e2-92e5-83aa9305e581 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:52.942590 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4681a-4307-46e2-92e5-83aa9305e581 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:52.942590 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4681a-4307-46e2-92e5-83aa9305e581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:52.992087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-b7b4681a-4307-46e2-92e5-83aa9305e581 None None] MFA Rules not processed for user `c0672efa012d46379c195c0460a0002f`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:45:52.993330 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-b7b4681a-4307-46e2-92e5-83aa9305e581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:53.118980 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 594/1183] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:45:52 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:45:53.123824 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56b8d4-a198-4c80-a643-4ec1d63cdb0d service neutron] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:53.138841 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56b8d4-a198-4c80-a643-4ec1d63cdb0d service neutron] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:53.144090 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6213e-fa3d-447d-8a79-a1c81efd9758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:53.144742 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6213e-fa3d-447d-8a79-a1c81efd9758 admin admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:53.145026 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6213e-fa3d-447d-8a79-a1c81efd9758 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:53.145691 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6213e-fa3d-447d-8a79-a1c81efd9758 admin admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:53.145920 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6213e-fa3d-447d-8a79-a1c81efd9758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:53.147887 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6213e-fa3d-447d-8a79-a1c81efd9758 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:53.302757 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 590/1184] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Aug 23 16:45:53 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:45:53.306586 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4681a-4307-46e2-92e5-83aa9305e581 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:53.319028 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4681a-4307-46e2-92e5-83aa9305e581 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:53.382660 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121ebf4-b5d3-42a8-9545-56373096c3f1 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:53.383148 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121ebf4-b5d3-42a8-9545-56373096c3f1 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:53.383450 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121ebf4-b5d3-42a8-9545-56373096c3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:53.419030 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=100 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:53.424878 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-3121ebf4-b5d3-42a8-9545-56373096c3f1 None None] MFA Rules not processed for user `98771733cc4b495bb515bccf10d7e9b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:45:53.430525 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-3121ebf4-b5d3-42a8-9545-56373096c3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:53.453480 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2c052-4488-4c42-a0cd-578cc9c5e624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:53.453964 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2c052-4488-4c42-a0cd-578cc9c5e624 admin admin] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:53.454254 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2c052-4488-4c42-a0cd-578cc9c5e624 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:53.454865 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2c052-4488-4c42-a0cd-578cc9c5e624 admin admin] PATH_INFO: `/v3/users` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:53.455030 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2c052-4488-4c42-a0cd-578cc9c5e624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:53.457656 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2c052-4488-4c42-a0cd-578cc9c5e624 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:53.536389 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 591/1185] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:45:53 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:45:53.540771 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 595/1186] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Aug 23 16:45:53 2022] POST /identity/v3/users => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:45:53.541041 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121ebf4-b5d3-42a8-9545-56373096c3f1 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:53.551943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2c052-4488-4c42-a0cd-578cc9c5e624 admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:53.554298 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121ebf4-b5d3-42a8-9545-56373096c3f1 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:53.560566 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e59e89-6173-4f6b-8564-1d0adaaf95c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:53.561305 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e59e89-6173-4f6b-8564-1d0adaaf95c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:53.561686 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e59e89-6173-4f6b-8564-1d0adaaf95c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:53.562062 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e59e89-6173-4f6b-8564-1d0adaaf95c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:53.562811 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e59e89-6173-4f6b-8564-1d0adaaf95c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:53.565709 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e59e89-6173-4f6b-8564-1d0adaaf95c3 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:53.567957 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2c052-4488-4c42-a0cd-578cc9c5e624 admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:53.573483 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc16c6-4baa-4085-bf29-a6e4d7714ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:53.574628 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc16c6-4baa-4085-bf29-a6e4d7714ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:53.574918 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc16c6-4baa-4085-bf29-a6e4d7714ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:53.575195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc16c6-4baa-4085-bf29-a6e4d7714ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:53.576390 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc16c6-4baa-4085-bf29-a6e4d7714ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:53.578513 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc16c6-4baa-4085-bf29-a6e4d7714ba8 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:53.592924 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 596/1187] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Aug 23 16:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:45:53.600117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc16c6-4baa-4085-bf29-a6e4d7714ba8 admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:53.612134 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc16c6-4baa-4085-bf29-a6e4d7714ba8 admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:53.617063 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf8737-a969-4d83-a733-81926bfc588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:53.617755 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf8737-a969-4d83-a733-81926bfc588a admin admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:53.618035 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf8737-a969-4d83-a733-81926bfc588a admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:53.618312 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf8737-a969-4d83-a733-81926bfc588a admin admin] PATH_INFO: `/v3/projects/601044b54792473f8bd079c083669964/users/cb65749e24e0448f8bf80f34a1fc0f87/roles/091802a86e334e129210219b7c69359d` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:53.639899 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf8737-a969-4d83-a733-81926bfc588a admin admin] RBAC: Authorizing `identity:create_grant(project_id=601044b54792473f8bd079c083669964, user_id=cb65749e24e0448f8bf80f34a1fc0f87, role_id=091802a86e334e129210219b7c69359d)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:53.643695 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf8737-a969-4d83-a733-81926bfc588a admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:53.696899 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 592/1188] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Aug 23 16:45:53 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:45:53.700993 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e59e89-6173-4f6b-8564-1d0adaaf95c3 admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:53.741963 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:53.744315 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 597/1189] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Aug 23 16:45:53 2022] PUT /identity/v3/projects/601044b54792473f8bd079c083669964/users/cb65749e24e0448f8bf80f34a1fc0f87/roles/091802a86e334e129210219b7c69359d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:45:53.745286 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf8737-a969-4d83-a733-81926bfc588a admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:53.788718 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e59e89-6173-4f6b-8564-1d0adaaf95c3 admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:53.865384 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf8737-a969-4d83-a733-81926bfc588a admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:53.873893 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb487d3b-7101-4c7b-b8e1-5dabbf1a4f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:53.874526 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb487d3b-7101-4c7b-b8e1-5dabbf1a4f66 admin admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:53.874851 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb487d3b-7101-4c7b-b8e1-5dabbf1a4f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:53.877117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb487d3b-7101-4c7b-b8e1-5dabbf1a4f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:53.877117 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb487d3b-7101-4c7b-b8e1-5dabbf1a4f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:53.879944 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb487d3b-7101-4c7b-b8e1-5dabbf1a4f66 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:53.895883 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 598/1190] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Aug 23 16:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:45:53.900776 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e21dc-826c-4c56-af09-1eb7522d2278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:53.901331 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb487d3b-7101-4c7b-b8e1-5dabbf1a4f66 admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:53.907768 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e21dc-826c-4c56-af09-1eb7522d2278 admin admin] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:53.907768 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e21dc-826c-4c56-af09-1eb7522d2278 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:53.907768 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e21dc-826c-4c56-af09-1eb7522d2278 admin admin] PATH_INFO: `/v3/users` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:53.907768 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e21dc-826c-4c56-af09-1eb7522d2278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:53.907768 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e21dc-826c-4c56-af09-1eb7522d2278 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:53.920370 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb487d3b-7101-4c7b-b8e1-5dabbf1a4f66 admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:53.927258 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e74d00-e1f1-4528-80f1-9c71afcc755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:53.927944 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e74d00-e1f1-4528-80f1-9c71afcc755e admin admin] REQUEST_METHOD: `PUT` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:53.928222 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e74d00-e1f1-4528-80f1-9c71afcc755e admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:53.928492 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e74d00-e1f1-4528-80f1-9c71afcc755e admin admin] PATH_INFO: `/v3/projects/601044b54792473f8bd079c083669964/users/cb65749e24e0448f8bf80f34a1fc0f87/roles/091802a86e334e129210219b7c69359d` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:53.930853 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e74d00-e1f1-4528-80f1-9c71afcc755e admin admin] RBAC: Authorizing `identity:create_grant(project_id=601044b54792473f8bd079c083669964, user_id=cb65749e24e0448f8bf80f34a1fc0f87, role_id=091802a86e334e129210219b7c69359d)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:53.939733 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e74d00-e1f1-4528-80f1-9c71afcc755e admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:53.960688 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 599/1191] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Aug 23 16:45:53 2022] PUT /identity/v3/projects/601044b54792473f8bd079c083669964/users/cb65749e24e0448f8bf80f34a1fc0f87/roles/091802a86e334e129210219b7c69359d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:45:54.005853 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 593/1192] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Aug 23 16:45:53 2022] POST /identity/v3/users => generated 295 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:45:54.008747 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e74d00-e1f1-4528-80f1-9c71afcc755e admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:54.088625 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e74d00-e1f1-4528-80f1-9c71afcc755e admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:54.093562 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ce33c-99dd-4686-8858-f49592abff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:54.094175 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ce33c-99dd-4686-8858-f49592abff97 admin admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:54.094450 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ce33c-99dd-4686-8858-f49592abff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:54.094714 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ce33c-99dd-4686-8858-f49592abff97 admin admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:54.095445 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ce33c-99dd-4686-8858-f49592abff97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:54.097057 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ce33c-99dd-4686-8858-f49592abff97 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:54.111790 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 600/1193] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Aug 23 16:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:45:54.113339 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e21dc-826c-4c56-af09-1eb7522d2278 admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:54.124000 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e21dc-826c-4c56-af09-1eb7522d2278 admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:54.129386 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1420e84-8776-41fc-80a6-29c333cf5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:54.131561 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1420e84-8776-41fc-80a6-29c333cf5712 admin admin] REQUEST_METHOD: `PUT` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:54.131561 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1420e84-8776-41fc-80a6-29c333cf5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:54.131561 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1420e84-8776-41fc-80a6-29c333cf5712 admin admin] PATH_INFO: `/v3/projects/140d25db83bd4acdaf13fe0b77448f76/users/133a8adcdbef4df4bc61d112d153f79e/roles/091802a86e334e129210219b7c69359d` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:54.151984 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1420e84-8776-41fc-80a6-29c333cf5712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=140d25db83bd4acdaf13fe0b77448f76, user_id=133a8adcdbef4df4bc61d112d153f79e, role_id=091802a86e334e129210219b7c69359d)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:54.156243 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1420e84-8776-41fc-80a6-29c333cf5712 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:54.278729 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 594/1194] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Aug 23 16:45:54 2022] PUT /identity/v3/projects/140d25db83bd4acdaf13fe0b77448f76/users/133a8adcdbef4df4bc61d112d153f79e/roles/091802a86e334e129210219b7c69359d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:45:54.283082 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ce33c-99dd-4686-8858-f49592abff97 admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:54.294302 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ce33c-99dd-4686-8858-f49592abff97 admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:54.317974 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:54.375169 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1651897-b27b-4b8c-8ca3-2a889bc0ebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:54.375846 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651897-b27b-4b8c-8ca3-2a889bc0ebb6 admin admin] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:54.376121 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651897-b27b-4b8c-8ca3-2a889bc0ebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:54.376393 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651897-b27b-4b8c-8ca3-2a889bc0ebb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:54.377075 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1651897-b27b-4b8c-8ca3-2a889bc0ebb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:54.378668 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1651897-b27b-4b8c-8ca3-2a889bc0ebb6 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:54.391161 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 601/1195] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Aug 23 16:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:45:54.396107 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1420e84-8776-41fc-80a6-29c333cf5712 admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:54.410949 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1420e84-8776-41fc-80a6-29c333cf5712 admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:54.421825 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894f9d1-954a-42d9-8a08-c5cb8cbcd7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:54.422758 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894f9d1-954a-42d9-8a08-c5cb8cbcd7a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:54.422981 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894f9d1-954a-42d9-8a08-c5cb8cbcd7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:54.423302 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894f9d1-954a-42d9-8a08-c5cb8cbcd7a4 admin admin] PATH_INFO: `/v3/projects/140d25db83bd4acdaf13fe0b77448f76/users/133a8adcdbef4df4bc61d112d153f79e/roles/091802a86e334e129210219b7c69359d` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:54.426754 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894f9d1-954a-42d9-8a08-c5cb8cbcd7a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=140d25db83bd4acdaf13fe0b77448f76, user_id=133a8adcdbef4df4bc61d112d153f79e, role_id=091802a86e334e129210219b7c69359d)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:54.434602 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894f9d1-954a-42d9-8a08-c5cb8cbcd7a4 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:54.472026 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 595/1196] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Aug 23 16:45:54 2022] PUT /identity/v3/projects/140d25db83bd4acdaf13fe0b77448f76/users/133a8adcdbef4df4bc61d112d153f79e/roles/091802a86e334e129210219b7c69359d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:46:01.002281 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e967-779e-4b17-98f3-e517263243e5 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:01.002912 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e967-779e-4b17-98f3-e517263243e5 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:01.002912 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e967-779e-4b17-98f3-e517263243e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:01.042603 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-e3c8e967-779e-4b17-98f3-e517263243e5 None None] MFA Rules not processed for user `cb65749e24e0448f8bf80f34a1fc0f87`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:46:01.044324 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-e3c8e967-779e-4b17-98f3-e517263243e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:01.189931 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 602/1197] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:46:00 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:46:01.197912 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894f9d1-954a-42d9-8a08-c5cb8cbcd7a4 admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:46:01.199885 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-c894f9d1-954a-42d9-8a08-c5cb8cbcd7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:01.366598 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894f9d1-954a-42d9-8a08-c5cb8cbcd7a4 admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:46:01.381834 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08446605-89a0-45af-afbe-e518fdd05b1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ffdfa226444449817acbcccb0b1c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:46:01.382602 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08446605-89a0-45af-afbe-e518fdd05b1b service glance] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:01.408743 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08446605-89a0-45af-afbe-e518fdd05b1b service glance] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:01.408743 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08446605-89a0-45af-afbe-e518fdd05b1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:01.509045 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:01.533500 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08446605-89a0-45af-afbe-e518fdd05b1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:46:01.535041 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08446605-89a0-45af-afbe-e518fdd05b1b service glance] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:46:01.572941 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e86f9-b093-422c-8a9a-c847f5082cea None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:01.573182 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e86f9-b093-422c-8a9a-c847f5082cea None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:01.573434 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e86f9-b093-422c-8a9a-c847f5082cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:01.599698 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 596/1198] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:46:01 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:46:01.633612 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-983e86f9-b093-422c-8a9a-c847f5082cea None None] MFA Rules not processed for user `133a8adcdbef4df4bc61d112d153f79e`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:46:01.635670 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-983e86f9-b093-422c-8a9a-c847f5082cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:01.761248 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 603/1199] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:46:01 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:46:01.776232 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08446605-89a0-45af-afbe-e518fdd05b1b service glance] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:46:01.777929 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-08446605-89a0-45af-afbe-e518fdd05b1b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:01.790318 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08446605-89a0-45af-afbe-e518fdd05b1b service glance] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:46:01.795822 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b75012-5773-473a-8cc5-463a05887077 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ffdfa226444449817acbcccb0b1c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:46:01.796755 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b75012-5773-473a-8cc5-463a05887077 service glance] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:01.796755 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b75012-5773-473a-8cc5-463a05887077 service glance] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:01.797311 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b75012-5773-473a-8cc5-463a05887077 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:01.887143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b75012-5773-473a-8cc5-463a05887077 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:46:01.890219 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b75012-5773-473a-8cc5-463a05887077 service glance] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:46:01.903149 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 597/1200] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:46:01 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:46:11.757168 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=88 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:11.897722 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=34 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:11.971284 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e285c-f82c-4525-80f1-ea61080fa865 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:11.972338 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e285c-f82c-4525-80f1-ea61080fa865 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:11.975894 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e285c-f82c-4525-80f1-ea61080fa865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:11.997045 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-189e285c-f82c-4525-80f1-ea61080fa865 None None] MFA Rules not processed for user `c0672efa012d46379c195c0460a0002f`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:46:12.007613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-189e285c-f82c-4525-80f1-ea61080fa865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:12.007613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 604/1201] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:46:11 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:46:12.319516 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ae591-fde3-401b-96e1-72cb3fa6378c None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:12.319805 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ae591-fde3-401b-96e1-72cb3fa6378c None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:12.320083 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ae591-fde3-401b-96e1-72cb3fa6378c None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:12.321398 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 598/1202] 10.222.0.18 () {54 vars in 962 bytes} [Tue Aug 23 16:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:46:12.326802 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaaa0be-08ee-492b-8af0-bc33aa097bb9 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:12.327089 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaaa0be-08ee-492b-8af0-bc33aa097bb9 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:12.327412 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaaa0be-08ee-492b-8af0-bc33aa097bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:12.348818 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-0eaaa0be-08ee-492b-8af0-bc33aa097bb9 None None] MFA Rules not processed for user `db2c2345bf6e487bb3451fd6ce17f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:46:12.353852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-0eaaa0be-08ee-492b-8af0-bc33aa097bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:12.425659 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 605/1203] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Aug 23 16:46:12 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:46:12.430452 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4ee9f-98eb-4ea1-9c5f-71a389c15e99 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:12.430739 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4ee9f-98eb-4ea1-9c5f-71a389c15e99 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:12.431075 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4ee9f-98eb-4ea1-9c5f-71a389c15e99 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:12.432371 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 599/1204] 10.222.0.18 () {54 vars in 912 bytes} [Tue Aug 23 16:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:46:12.438011 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3bd4f-bbed-42d7-93b8-827dc947f3a1 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:12.438294 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3bd4f-bbed-42d7-93b8-827dc947f3a1 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:12.438569 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3bd4f-bbed-42d7-93b8-827dc947f3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:12.462064 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-abd3bd4f-bbed-42d7-93b8-827dc947f3a1 None None] MFA Rules not processed for user `db2c2345bf6e487bb3451fd6ce17f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:46:12.463491 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-abd3bd4f-bbed-42d7-93b8-827dc947f3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:12.473022 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 606/1205] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Aug 23 16:46:12 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:46:12.484891 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4ee9f-98eb-4ea1-9c5f-71a389c15e99 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:46:12.497155 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4ee9f-98eb-4ea1-9c5f-71a389c15e99 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:46:12.501217 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2426e1-0629-4def-a003-8f58c6eca73b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ffdfa226444449817acbcccb0b1c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:46:12.501826 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2426e1-0629-4def-a003-8f58c6eca73b service glance] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:12.502111 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2426e1-0629-4def-a003-8f58c6eca73b service glance] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:12.502561 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2426e1-0629-4def-a003-8f58c6eca73b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:12.514438 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2426e1-0629-4def-a003-8f58c6eca73b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:46:12.516188 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2426e1-0629-4def-a003-8f58c6eca73b service glance] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:46:12.528730 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 600/1206] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:46:12 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:46:12.996572 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892fff2-4aa0-4d72-a39f-cc13f70ee854 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:12.997285 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892fff2-4aa0-4d72-a39f-cc13f70ee854 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:12.997285 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892fff2-4aa0-4d72-a39f-cc13f70ee854 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:12.999339 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 607/1207] 10.222.0.18 () {54 vars in 912 bytes} [Tue Aug 23 16:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:46:13.005508 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092408e-ed87-4599-8100-07d7c47373c9 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:13.006196 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092408e-ed87-4599-8100-07d7c47373c9 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:13.006196 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092408e-ed87-4599-8100-07d7c47373c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:13.029798 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-7092408e-ed87-4599-8100-07d7c47373c9 None None] MFA Rules not processed for user `74e4ab73defe45cb90e60e5719c5d0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:46:13.031184 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-7092408e-ed87-4599-8100-07d7c47373c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:13.093147 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 601/1208] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Aug 23 16:46:13 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:46:13.111546 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892fff2-4aa0-4d72-a39f-cc13f70ee854 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:46:13.132433 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892fff2-4aa0-4d72-a39f-cc13f70ee854 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:46:13.141276 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd0302-b270-4e3f-bfa8-24279bf01be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:46:13.141956 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd0302-b270-4e3f-bfa8-24279bf01be9 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:13.142272 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd0302-b270-4e3f-bfa8-24279bf01be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:13.142594 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd0302-b270-4e3f-bfa8-24279bf01be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:13.156826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd0302-b270-4e3f-bfa8-24279bf01be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:46:13.158281 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd0302-b270-4e3f-bfa8-24279bf01be9 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:46:13.175503 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 608/1209] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:46:13 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:46:13.727658 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20f28-d3c4-484a-ab52-67dd3e067b27 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:13.727946 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20f28-d3c4-484a-ab52-67dd3e067b27 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:13.728224 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20f28-d3c4-484a-ab52-67dd3e067b27 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:13.729936 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 602/1210] 10.222.0.18 () {54 vars in 962 bytes} [Tue Aug 23 16:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:46:13.747749 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231505c-3b8a-4460-85ed-e7880e155f07 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:13.748322 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231505c-3b8a-4460-85ed-e7880e155f07 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:13.748877 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231505c-3b8a-4460-85ed-e7880e155f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:13.764272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ef159-4fbc-4573-941c-176eaa3c4277 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:13.764595 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ef159-4fbc-4573-941c-176eaa3c4277 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:13.764826 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ef159-4fbc-4573-941c-176eaa3c4277 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:13.769729 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 603/1211] 10.222.0.18 () {54 vars in 961 bytes} [Tue Aug 23 16:46:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:46:13.774570 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b865-1532-47d9-90f8-795932f072b1 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:13.774925 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b865-1532-47d9-90f8-795932f072b1 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:13.775307 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b865-1532-47d9-90f8-795932f072b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:13.789065 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-5231505c-3b8a-4460-85ed-e7880e155f07 None None] MFA Rules not processed for user `db2c2345bf6e487bb3451fd6ce17f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:46:13.790338 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-5231505c-3b8a-4460-85ed-e7880e155f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:13.800129 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 609/1212] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Aug 23 16:46:13 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:46:13.806240 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-2839b865-1532-47d9-90f8-795932f072b1 None None] MFA Rules not processed for user `eef56a81a66744b2a3e468b7f182f9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:46:13.806835 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffe0dc-195f-4177-bbe3-c3a5bab43853 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:13.807122 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffe0dc-195f-4177-bbe3-c3a5bab43853 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:13.807493 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffe0dc-195f-4177-bbe3-c3a5bab43853 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:13.808186 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-2839b865-1532-47d9-90f8-795932f072b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:13.809143 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 610/1213] 10.222.0.18 () {54 vars in 912 bytes} [Tue Aug 23 16:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:46:13.814973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc72192-f774-4af6-89f1-6cfebf508711 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:13.815349 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc72192-f774-4af6-89f1-6cfebf508711 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:13.815557 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc72192-f774-4af6-89f1-6cfebf508711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:13.846402 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-3bc72192-f774-4af6-89f1-6cfebf508711 None None] MFA Rules not processed for user `db2c2345bf6e487bb3451fd6ce17f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:46:13.847636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-3bc72192-f774-4af6-89f1-6cfebf508711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:13.867295 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 611/1214] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Aug 23 16:46:13 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:46:13.880643 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc72192-f774-4af6-89f1-6cfebf508711 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:46:13.899889 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc72192-f774-4af6-89f1-6cfebf508711 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:46:13.904945 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb69a-0a8e-4f92-8b28-d97c1485d99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:46:13.906091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb69a-0a8e-4f92-8b28-d97c1485d99b service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:13.906275 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb69a-0a8e-4f92-8b28-d97c1485d99b service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:13.906619 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb69a-0a8e-4f92-8b28-d97c1485d99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:13.922581 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bb69a-0a8e-4f92-8b28-d97c1485d99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:46:13.924513 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bb69a-0a8e-4f92-8b28-d97c1485d99b service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:46:13.938172 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 612/1215] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:46:13 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:46:13.942466 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 604/1216] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Aug 23 16:46:13 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:46:13.955708 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb69a-0a8e-4f92-8b28-d97c1485d99b service neutron] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:46:13.967324 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb69a-0a8e-4f92-8b28-d97c1485d99b service neutron] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:46:13.973955 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522afa3a-ce85-4473-b1fb-5d13054fcad7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef56a81a66744b2a3e468b7f182f9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:46:13.974568 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522afa3a-ce85-4473-b1fb-5d13054fcad7 service placement] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:13.974843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522afa3a-ce85-4473-b1fb-5d13054fcad7 service placement] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:13.975113 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522afa3a-ce85-4473-b1fb-5d13054fcad7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:13.976993 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-522afa3a-ce85-4473-b1fb-5d13054fcad7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:13.990077 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522afa3a-ce85-4473-b1fb-5d13054fcad7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:46:13.991704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522afa3a-ce85-4473-b1fb-5d13054fcad7 service placement] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:46:14.008632 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 613/1217] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:46:13 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:46:23.924439 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=58 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:24.000491 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=59 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:28.607366 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368733fa-e306-403f-8f42-85706410293f None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:28.608001 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368733fa-e306-403f-8f42-85706410293f None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:28.608001 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368733fa-e306-403f-8f42-85706410293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:28.628023 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-368733fa-e306-403f-8f42-85706410293f None None] MFA Rules not processed for user `74e4ab73defe45cb90e60e5719c5d0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:46:28.629276 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-368733fa-e306-403f-8f42-85706410293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:28.635998 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 605/1218] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Aug 23 16:46:28 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:46:28.648792 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522afa3a-ce85-4473-b1fb-5d13054fcad7 service placement] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:46:28.658526 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522afa3a-ce85-4473-b1fb-5d13054fcad7 service placement] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:46:28.663154 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c41f1-5b2b-4f29-899f-c101ce9b385f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:46:28.663810 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c41f1-5b2b-4f29-899f-c101ce9b385f service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:28.664091 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c41f1-5b2b-4f29-899f-c101ce9b385f service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:28.664353 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c41f1-5b2b-4f29-899f-c101ce9b385f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:28.673068 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c41f1-5b2b-4f29-899f-c101ce9b385f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:46:28.674504 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c41f1-5b2b-4f29-899f-c101ce9b385f service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:46:28.694803 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 614/1219] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:46:28 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:46:29.744808 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c05c15-f4dc-40d2-a9b4-fb35eb502e1e None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:29.745780 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c05c15-f4dc-40d2-a9b4-fb35eb502e1e None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:29.746229 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c05c15-f4dc-40d2-a9b4-fb35eb502e1e None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:29.747803 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 606/1220] 10.222.0.18 () {54 vars in 921 bytes} [Tue Aug 23 16:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:46:29.764411 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e3ae1-5bf3-47d4-945d-5ee80b9ad060 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:29.765021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e3ae1-5bf3-47d4-945d-5ee80b9ad060 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:29.765021 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e3ae1-5bf3-47d4-945d-5ee80b9ad060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:29.791861 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-447e3ae1-5bf3-47d4-945d-5ee80b9ad060 None None] MFA Rules not processed for user `db2c2345bf6e487bb3451fd6ce17f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:46:29.793078 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-447e3ae1-5bf3-47d4-945d-5ee80b9ad060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:29.803521 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 615/1221] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Aug 23 16:46:29 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:46:29.825905 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c05c15-f4dc-40d2-a9b4-fb35eb502e1e None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:46:29.840885 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c05c15-f4dc-40d2-a9b4-fb35eb502e1e None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:46:29.846969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0f705-d79d-41a8-82b1-9d5976ddf3d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:46:29.846969 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0f705-d79d-41a8-82b1-9d5976ddf3d8 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:29.847808 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0f705-d79d-41a8-82b1-9d5976ddf3d8 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:29.847808 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0f705-d79d-41a8-82b1-9d5976ddf3d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:29.858567 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0f705-d79d-41a8-82b1-9d5976ddf3d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:46:29.860878 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0f705-d79d-41a8-82b1-9d5976ddf3d8 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:46:29.873867 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 607/1222] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:46:29 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:46:37.602944 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc743f-e303-40d0-a2f0-51a6c92f3049 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:37.604180 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc743f-e303-40d0-a2f0-51a6c92f3049 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:37.604180 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc743f-e303-40d0-a2f0-51a6c92f3049 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:37.605110 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 616/1223] 10.222.0.18 () {54 vars in 921 bytes} [Tue Aug 23 16:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:46:37.619461 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e21c8f-584e-45fb-908f-4bf11c8f5cf7 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:37.620095 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e21c8f-584e-45fb-908f-4bf11c8f5cf7 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:37.620324 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e21c8f-584e-45fb-908f-4bf11c8f5cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:37.641717 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-52e21c8f-584e-45fb-908f-4bf11c8f5cf7 None None] MFA Rules not processed for user `db2c2345bf6e487bb3451fd6ce17f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:46:37.643143 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-52e21c8f-584e-45fb-908f-4bf11c8f5cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:46:37.655591 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 608/1224] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Aug 23 16:46:37 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:46:37.669919 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc743f-e303-40d0-a2f0-51a6c92f3049 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:46:37.684111 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc743f-e303-40d0-a2f0-51a6c92f3049 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:46:37.689315 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abc4ac-42b3-4f65-b887-a3ca540cd84f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:46:37.689852 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abc4ac-42b3-4f65-b887-a3ca540cd84f service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:37.690132 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abc4ac-42b3-4f65-b887-a3ca540cd84f service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:37.690407 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abc4ac-42b3-4f65-b887-a3ca540cd84f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:37.699834 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abc4ac-42b3-4f65-b887-a3ca540cd84f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:46:37.701410 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abc4ac-42b3-4f65-b887-a3ca540cd84f service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:46:37.714100 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 617/1225] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:46:37 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:46:47.637098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=12 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:47.707540 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=15 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:56.147312 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e21c8f-584e-45fb-908f-4bf11c8f5cf7 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:46:56.159876 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e21c8f-584e-45fb-908f-4bf11c8f5cf7 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:46:56.164776 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c807a-375d-4f21-bef9-1730e79a4913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:46:56.165501 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c807a-375d-4f21-bef9-1730e79a4913 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:46:56.165830 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c807a-375d-4f21-bef9-1730e79a4913 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:46:56.166150 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c807a-375d-4f21-bef9-1730e79a4913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:46:56.196970 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c807a-375d-4f21-bef9-1730e79a4913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:46:56.199796 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c807a-375d-4f21-bef9-1730e79a4913 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:46:56.221722 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 609/1226] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:46:56 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:47:06.211335 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=6 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:48:30.702116 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df9a27-90ba-4a76-a49c-d2c216ed8aed None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:48:30.702743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df9a27-90ba-4a76-a49c-d2c216ed8aed None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:48:30.702743 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df9a27-90ba-4a76-a49c-d2c216ed8aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:48:30.733943 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-50df9a27-90ba-4a76-a49c-d2c216ed8aed None None] MFA Rules not processed for user `98771733cc4b495bb515bccf10d7e9b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:48:30.735380 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-50df9a27-90ba-4a76-a49c-d2c216ed8aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:48:30.771557 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 618/1227] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:48:30 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:48:40.766839 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=15 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:49:13.494621 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa1297-6c0d-4c7c-b78b-113378eb3a7a None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:49:13.495297 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa1297-6c0d-4c7c-b78b-113378eb3a7a None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:49:13.495297 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa1297-6c0d-4c7c-b78b-113378eb3a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:49:13.515879 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-36fa1297-6c0d-4c7c-b78b-113378eb3a7a None None] MFA Rules not processed for user `98771733cc4b495bb515bccf10d7e9b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:49:13.517139 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-36fa1297-6c0d-4c7c-b78b-113378eb3a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:49:13.525014 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 610/1228] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:49:13 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:49:20.298631 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df9a27-90ba-4a76-a49c-d2c216ed8aed None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:49:20.349362 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df9a27-90ba-4a76-a49c-d2c216ed8aed None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:49:20.355287 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ca223-f493-46f9-9d28-1a89d86c7d15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef56a81a66744b2a3e468b7f182f9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:49:20.355904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca223-f493-46f9-9d28-1a89d86c7d15 service placement] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:49:20.356181 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca223-f493-46f9-9d28-1a89d86c7d15 service placement] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:49:20.356450 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca223-f493-46f9-9d28-1a89d86c7d15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:49:20.366177 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ca223-f493-46f9-9d28-1a89d86c7d15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:49:20.368749 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ca223-f493-46f9-9d28-1a89d86c7d15 service placement] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:49:20.380950 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 619/1229] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:49:20 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:49:23.509702 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=3 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:49:30.375648 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=19 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:49:38.356024 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be99645-99b9-42b7-adc3-eadbff731dac None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:49:38.356626 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be99645-99b9-42b7-adc3-eadbff731dac None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:49:38.356626 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be99645-99b9-42b7-adc3-eadbff731dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:49:38.387378 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-2be99645-99b9-42b7-adc3-eadbff731dac None None] MFA Rules not processed for user `98771733cc4b495bb515bccf10d7e9b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:49:38.389512 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-2be99645-99b9-42b7-adc3-eadbff731dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:49:38.402432 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 611/1230] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:49:38 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:49:48.378248 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=3 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:03.045249 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ca223-f493-46f9-9d28-1a89d86c7d15 service placement] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:51:03.111422 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ca223-f493-46f9-9d28-1a89d86c7d15 service placement] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:51:03.115196 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ac221-3b79-41c7-a90d-eb00914abfb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e1b4d1056614edea1585de5e531ed96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:51:03.115848 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ac221-3b79-41c7-a90d-eb00914abfb4 service cinder] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:51:03.116149 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ac221-3b79-41c7-a90d-eb00914abfb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:51:03.116420 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ac221-3b79-41c7-a90d-eb00914abfb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:51:03.125559 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ac221-3b79-41c7-a90d-eb00914abfb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:51:03.126983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ac221-3b79-41c7-a90d-eb00914abfb4 service cinder] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:51:03.136046 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 620/1231] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:51:03 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:51:13.131855 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=30 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:15.004978 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553a36-2302-4163-b441-55669f4ececc None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:51:15.005586 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553a36-2302-4163-b441-55669f4ececc None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:51:15.005586 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553a36-2302-4163-b441-55669f4ececc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:51:15.026608 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-53553a36-2302-4163-b441-55669f4ececc None None] MFA Rules not processed for user `98771733cc4b495bb515bccf10d7e9b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:51:15.027889 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-53553a36-2302-4163-b441-55669f4ececc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:51:15.035544 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 612/1232] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:51:15 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:51:15.093752 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ac221-3b79-41c7-a90d-eb00914abfb4 service cinder] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:51:15.105661 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ac221-3b79-41c7-a90d-eb00914abfb4 service cinder] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:51:15.109747 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05cab6-26e7-4cd8-a96d-bf3756f47fcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e1b4d1056614edea1585de5e531ed96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:51:15.110382 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05cab6-26e7-4cd8-a96d-bf3756f47fcd service cinder] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:51:15.113655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05cab6-26e7-4cd8-a96d-bf3756f47fcd service cinder] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:51:15.113655 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05cab6-26e7-4cd8-a96d-bf3756f47fcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:51:15.122180 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05cab6-26e7-4cd8-a96d-bf3756f47fcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:51:15.123793 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05cab6-26e7-4cd8-a96d-bf3756f47fcd service cinder] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:51:15.147441 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 621/1233] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:51:15 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:51:15.536720 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0ba91-3575-4409-aa86-449d9d37c751 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:51:15.537099 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0ba91-3575-4409-aa86-449d9d37c751 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:51:15.537462 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0ba91-3575-4409-aa86-449d9d37c751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:51:15.623006 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-3dc0ba91-3575-4409-aa86-449d9d37c751 None None] MFA Rules not processed for user `74e4ab73defe45cb90e60e5719c5d0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:51:15.624286 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-3dc0ba91-3575-4409-aa86-449d9d37c751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:51:15.642396 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 613/1234] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Aug 23 16:51:15 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:51:15.654636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05cab6-26e7-4cd8-a96d-bf3756f47fcd service cinder] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:51:15.664110 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05cab6-26e7-4cd8-a96d-bf3756f47fcd service cinder] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:51:15.668346 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220494f-293c-428c-acae-55dd1ae9b61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:51:15.668967 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220494f-293c-428c-acae-55dd1ae9b61c service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:51:15.669242 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220494f-293c-428c-acae-55dd1ae9b61c service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:51:15.669532 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220494f-293c-428c-acae-55dd1ae9b61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:51:15.677386 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220494f-293c-428c-acae-55dd1ae9b61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:51:15.680498 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220494f-293c-428c-acae-55dd1ae9b61c service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:51:15.687845 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 622/1235] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:51:15 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:51:16.558502 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0ba91-3575-4409-aa86-449d9d37c751 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:51:16.570100 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220494f-293c-428c-acae-55dd1ae9b61c service neutron] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:51:16.571398 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0ba91-3575-4409-aa86-449d9d37c751 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:51:16.576146 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220494f-293c-428c-acae-55dd1ae9b61c service neutron] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:51:16.577187 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212348a3-02ca-4ce7-bd90-9507c46b6068 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef56a81a66744b2a3e468b7f182f9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:51:16.577821 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212348a3-02ca-4ce7-bd90-9507c46b6068 service placement] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:51:16.578178 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212348a3-02ca-4ce7-bd90-9507c46b6068 service placement] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:51:16.578463 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212348a3-02ca-4ce7-bd90-9507c46b6068 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:51:16.581717 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab411b-dfa3-44b7-97ff-8791c432ae38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:51:16.582983 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab411b-dfa3-44b7-97ff-8791c432ae38 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:51:16.583600 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab411b-dfa3-44b7-97ff-8791c432ae38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:51:16.584026 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab411b-dfa3-44b7-97ff-8791c432ae38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:51:16.591829 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212348a3-02ca-4ce7-bd90-9507c46b6068 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:51:16.594834 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212348a3-02ca-4ce7-bd90-9507c46b6068 service placement] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:51:16.600042 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab411b-dfa3-44b7-97ff-8791c432ae38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:51:16.602746 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab411b-dfa3-44b7-97ff-8791c432ae38 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:51:16.613777 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 614/1236] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:51:16 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:51:16.621825 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 623/1237] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:51:16 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:51:26.605716 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=35 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:26.615121 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=22 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:31.602505 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212348a3-02ca-4ce7-bd90-9507c46b6068 service placement] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:51:31.617146 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212348a3-02ca-4ce7-bd90-9507c46b6068 service placement] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:51:31.621848 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98200581-e5d7-47e5-a719-63612a6d3177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:51:31.628060 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98200581-e5d7-47e5-a719-63612a6d3177 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:51:31.628060 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98200581-e5d7-47e5-a719-63612a6d3177 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:51:31.628060 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98200581-e5d7-47e5-a719-63612a6d3177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:51:31.631487 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98200581-e5d7-47e5-a719-63612a6d3177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:51:31.632971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98200581-e5d7-47e5-a719-63612a6d3177 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:51:31.644729 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 615/1238] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:51:31 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:51:34.894179 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab411b-dfa3-44b7-97ff-8791c432ae38 service neutron] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:51:34.909476 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab411b-dfa3-44b7-97ff-8791c432ae38 service neutron] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:51:34.915691 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023708b9-9467-443e-a62b-4acea2ac5f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:51:34.917306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023708b9-9467-443e-a62b-4acea2ac5f67 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:51:34.917811 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023708b9-9467-443e-a62b-4acea2ac5f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:51:34.918306 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023708b9-9467-443e-a62b-4acea2ac5f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:51:34.934799 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023708b9-9467-443e-a62b-4acea2ac5f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:51:34.937610 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023708b9-9467-443e-a62b-4acea2ac5f67 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:51:34.956233 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 624/1239] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:51:34 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:51:37.758594 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322c6b-a5f3-4c7b-a683-689edb6aad8b None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:51:37.771657 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322c6b-a5f3-4c7b-a683-689edb6aad8b None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:51:37.771657 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322c6b-a5f3-4c7b-a683-689edb6aad8b None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:51:37.771657 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 616/1240] 10.222.0.18 () {54 vars in 921 bytes} [Tue Aug 23 16:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:51:37.772262 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b1ed3-bf47-4faa-a7d5-215156060b8f None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:51:37.772262 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b1ed3-bf47-4faa-a7d5-215156060b8f None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:51:37.772262 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b1ed3-bf47-4faa-a7d5-215156060b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:51:37.835316 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-025b1ed3-bf47-4faa-a7d5-215156060b8f None None] MFA Rules not processed for user `db2c2345bf6e487bb3451fd6ce17f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:51:37.836549 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-025b1ed3-bf47-4faa-a7d5-215156060b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:51:37.846799 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 625/1241] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Aug 23 16:51:37 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:51:37.859803 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322c6b-a5f3-4c7b-a683-689edb6aad8b None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:51:37.875145 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322c6b-a5f3-4c7b-a683-689edb6aad8b None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:51:37.881355 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81378e-1bde-462d-b9fb-d32621889b9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:51:37.882267 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81378e-1bde-462d-b9fb-d32621889b9e service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:51:37.882748 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81378e-1bde-462d-b9fb-d32621889b9e service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:51:37.883300 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81378e-1bde-462d-b9fb-d32621889b9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:51:37.899446 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81378e-1bde-462d-b9fb-d32621889b9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:51:37.901655 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81378e-1bde-462d-b9fb-d32621889b9e service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:51:37.912999 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 617/1242] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:51:37 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:51:47.832033 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=20 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:47.908257 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=12 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:52:05.815431 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b1ed3-bf47-4faa-a7d5-215156060b8f None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:52:05.826867 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b1ed3-bf47-4faa-a7d5-215156060b8f None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:52:05.832010 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb0a36-7d9d-49cb-a618-bfc76a50160b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:52:05.832627 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0a36-7d9d-49cb-a618-bfc76a50160b service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:52:05.832903 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0a36-7d9d-49cb-a618-bfc76a50160b service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:52:05.833175 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0a36-7d9d-49cb-a618-bfc76a50160b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:52:05.842297 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb0a36-7d9d-49cb-a618-bfc76a50160b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:52:05.843985 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb0a36-7d9d-49cb-a618-bfc76a50160b service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:52:05.855269 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 626/1243] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:52:05 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:52:06.522272 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81378e-1bde-462d-b9fb-d32621889b9e service nova] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:52:06.536385 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81378e-1bde-462d-b9fb-d32621889b9e service nova] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:52:06.550492 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08537d-912b-4f80-a249-5e5c8c3c1339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:52:06.552235 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08537d-912b-4f80-a249-5e5c8c3c1339 service nova] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:52:06.552817 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08537d-912b-4f80-a249-5e5c8c3c1339 service nova] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:52:06.553511 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08537d-912b-4f80-a249-5e5c8c3c1339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:52:06.567552 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08537d-912b-4f80-a249-5e5c8c3c1339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:52:06.570596 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08537d-912b-4f80-a249-5e5c8c3c1339 service nova] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:52:06.589877 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 618/1244] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:52:06 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:52:15.850191 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=6 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:52:16.579134 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=6 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:52:37.947967 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5f293-cdc7-4aad-8d72-8f1575a9dbe1 None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:52:37.948800 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5f293-cdc7-4aad-8d72-8f1575a9dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:52:37.948800 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5f293-cdc7-4aad-8d72-8f1575a9dbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:52:37.976300 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-a5f5f293-cdc7-4aad-8d72-8f1575a9dbe1 None None] MFA Rules not processed for user `c0672efa012d46379c195c0460a0002f`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:52:37.977541 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-a5f5f293-cdc7-4aad-8d72-8f1575a9dbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:52:37.984893 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 627/1245] 10.222.0.18 () {58 vars in 958 bytes} [Tue Aug 23 16:52:37 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:52:38.276630 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08537d-912b-4f80-a249-5e5c8c3c1339 service nova] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:52:38.286600 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08537d-912b-4f80-a249-5e5c8c3c1339 service nova] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:52:38.290776 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72a8ba-188a-4088-adc0-5f11b1ab2b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:52:38.291485 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72a8ba-188a-4088-adc0-5f11b1ab2b83 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:52:38.291822 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72a8ba-188a-4088-adc0-5f11b1ab2b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:52:38.292141 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72a8ba-188a-4088-adc0-5f11b1ab2b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:52:38.301971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72a8ba-188a-4088-adc0-5f11b1ab2b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:52:38.305414 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72a8ba-188a-4088-adc0-5f11b1ab2b83 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:52:38.313355 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 619/1246] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:52:38 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:52:47.970494 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=3 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:52:48.309331 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=6 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:01.836286 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5f293-cdc7-4aad-8d72-8f1575a9dbe1 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:53:01.873822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5f293-cdc7-4aad-8d72-8f1575a9dbe1 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:53:01.882658 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e522b1-5bf2-4c92-8c87-174c3d18b4a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db2c2345bf6e487bb3451fd6ce17f67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:53:01.884822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e522b1-5bf2-4c92-8c87-174c3d18b4a4 service nova] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:53:01.884822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e522b1-5bf2-4c92-8c87-174c3d18b4a4 service nova] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:53:01.884822 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e522b1-5bf2-4c92-8c87-174c3d18b4a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:53:01.899530 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e522b1-5bf2-4c92-8c87-174c3d18b4a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:53:01.902066 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e522b1-5bf2-4c92-8c87-174c3d18b4a4 service nova] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:53:01.914181 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 628/1247] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:53:01 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:53:11.911435 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=6 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:16.439431 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72a8ba-188a-4088-adc0-5f11b1ab2b83 service neutron] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:53:16.455020 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72a8ba-188a-4088-adc0-5f11b1ab2b83 service neutron] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:53:16.461669 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe71b6f-83b6-44c7-98f1-5b7e488ca76b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:53:16.466967 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe71b6f-83b6-44c7-98f1-5b7e488ca76b service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:53:16.466967 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe71b6f-83b6-44c7-98f1-5b7e488ca76b service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:53:16.466967 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe71b6f-83b6-44c7-98f1-5b7e488ca76b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:53:16.481619 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe71b6f-83b6-44c7-98f1-5b7e488ca76b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:53:16.484648 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe71b6f-83b6-44c7-98f1-5b7e488ca76b service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:53:16.500865 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 620/1248] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:53:16 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:53:26.494776 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=6 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:55:04.695566 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e522b1-5bf2-4c92-8c87-174c3d18b4a4 service nova] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:55:04.712721 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e522b1-5bf2-4c92-8c87-174c3d18b4a4 service nova] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:55:04.718985 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6989e-1737-49da-af37-aa34a51515ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef56a81a66744b2a3e468b7f182f9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:55:04.719633 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6989e-1737-49da-af37-aa34a51515ef service placement] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:55:04.720173 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6989e-1737-49da-af37-aa34a51515ef service placement] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:55:04.720444 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6989e-1737-49da-af37-aa34a51515ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:55:04.722386 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-54f6989e-1737-49da-af37-aa34a51515ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:55:04.752244 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6989e-1737-49da-af37-aa34a51515ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:55:04.753920 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6989e-1737-49da-af37-aa34a51515ef service placement] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:55:04.765470 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 629/1249] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:55:04 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:55:14.760646 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=11 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:55:22.563032 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe71b6f-83b6-44c7-98f1-5b7e488ca76b service neutron] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:55:22.565752 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-ffe71b6f-83b6-44c7-98f1-5b7e488ca76b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:55:22.580539 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe71b6f-83b6-44c7-98f1-5b7e488ca76b service neutron] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:55:22.584530 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b46a4-cf2b-4724-abcd-e274ee4f8ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:55:22.585159 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b46a4-cf2b-4724-abcd-e274ee4f8ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:55:22.585438 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b46a4-cf2b-4724-abcd-e274ee4f8ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:55:22.585761 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b46a4-cf2b-4724-abcd-e274ee4f8ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:55:22.669812 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b46a4-cf2b-4724-abcd-e274ee4f8ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:55:22.671391 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b46a4-cf2b-4724-abcd-e274ee4f8ed3 service neutron] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:55:22.693216 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 621/1250] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:55:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:55:27.492895 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9edf6-7770-49fa-b034-b3c709c199b3 None None] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:55:27.493739 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9edf6-7770-49fa-b034-b3c709c199b3 None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:55:27.493739 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9edf6-7770-49fa-b034-b3c709c199b3 None None] PATH_INFO: `/` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:55:27.496418 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 630/1251] 10.222.0.18 () {54 vars in 921 bytes} [Tue Aug 23 16:55:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:55:27.564303 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ab557-5f36-4330-ab49-3ad11b383a00 None None] REQUEST_METHOD: `POST` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:55:27.564886 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ab557-5f36-4330-ab49-3ad11b383a00 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:55:27.565293 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ab557-5f36-4330-ab49-3ad11b383a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:55:27.616719 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.auth.core [None req-dd1ab557-5f36-4330-ab49-3ad11b383a00 None None] MFA Rules not processed for user `eef56a81a66744b2a3e468b7f182f9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:55:27.617992 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-dd1ab557-5f36-4330-ab49-3ad11b383a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:55:27.628058 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 622/1252] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Aug 23 16:55:27 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:55:27.640415 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9edf6-7770-49fa-b034-b3c709c199b3 None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:55:27.656704 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9edf6-7770-49fa-b034-b3c709c199b3 None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:55:27.661908 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcf23e-24df-472d-93a6-e82959e8df93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef56a81a66744b2a3e468b7f182f9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:55:27.662591 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcf23e-24df-472d-93a6-e82959e8df93 service placement] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:55:27.662890 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcf23e-24df-472d-93a6-e82959e8df93 service placement] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:55:27.663298 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcf23e-24df-472d-93a6-e82959e8df93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:55:27.673431 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcf23e-24df-472d-93a6-e82959e8df93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:55:27.675053 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcf23e-24df-472d-93a6-e82959e8df93 service placement] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:55:27.686342 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 631/1253] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:55:27 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:55:32.070801 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018473ec-26fc-4958-a6ef-768d122c91e8 None None] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:55:32.071786 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018473ec-26fc-4958-a6ef-768d122c91e8 None None] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:55:32.072009 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018473ec-26fc-4958-a6ef-768d122c91e8 None None] PATH_INFO: `/` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:55:32.073819 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 623/1254] 10.222.0.18 () {54 vars in 921 bytes} [Tue Aug 23 16:55:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:55:32.103516 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66349d-7786-45d4-b660-1ba78693bf4a None None] REQUEST_METHOD: `POST` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:55:32.104276 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66349d-7786-45d4-b660-1ba78693bf4a None None] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:55:32.104276 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66349d-7786-45d4-b660-1ba78693bf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:55:32.131570 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.auth.core [None req-ae66349d-7786-45d4-b660-1ba78693bf4a None None] MFA Rules not processed for user `eef56a81a66744b2a3e468b7f182f9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88349) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:55:32.133772 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-ae66349d-7786-45d4-b660-1ba78693bf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:55:32.149195 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 632/1255] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Aug 23 16:55:32 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:55:32.163951 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018473ec-26fc-4958-a6ef-768d122c91e8 None None] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:55:32.185617 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018473ec-26fc-4958-a6ef-768d122c91e8 None None] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:55:32.192064 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e4a55-5ca1-4d1a-a3dc-4876b8493249 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef56a81a66744b2a3e468b7f182f9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:55:32.194580 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e4a55-5ca1-4d1a-a3dc-4876b8493249 service placement] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:55:32.194580 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e4a55-5ca1-4d1a-a3dc-4876b8493249 service placement] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:55:32.194580 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e4a55-5ca1-4d1a-a3dc-4876b8493249 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:55:32.203438 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e4a55-5ca1-4d1a-a3dc-4876b8493249 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:55:32.205070 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e4a55-5ca1-4d1a-a3dc-4876b8493249 service placement] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:55:32.216942 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 624/1256] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:55:32 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:55:32.247330 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66349d-7786-45d4-b660-1ba78693bf4a None None] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:55:32.260668 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66349d-7786-45d4-b660-1ba78693bf4a None None] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:55:32.266235 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:55:32.267087 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:55:32.267498 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:55:32.267944 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] PATH_INFO: `/v3/users/98771733cc4b495bb515bccf10d7e9b5` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:55:32.269384 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=98771733cc4b495bb515bccf10d7e9b5)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:55:32.271843 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:55:32.560964 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98771733cc4b495bb515bccf10d7e9b5'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:32.562012 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98771733cc4b495bb515bccf10d7e9b5'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:32.675633 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98771733cc4b495bb515bccf10d7e9b5'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:32.691475 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98771733cc4b495bb515bccf10d7e9b5'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:32.692224 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98771733cc4b495bb515bccf10d7e9b5'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:32.706826 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 633/1257] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Aug 23 16:55:32 2022] DELETE /identity/v3/users/98771733cc4b495bb515bccf10d7e9b5 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:55:33.102263 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e4a55-5ca1-4d1a-a3dc-4876b8493249 service placement] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:55:33.113441 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e4a55-5ca1-4d1a-a3dc-4876b8493249 service placement] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:55:33.186334 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:55:33.187131 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:55:33.187509 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:55:33.187828 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] PATH_INFO: `/v3/projects/b46ead312aa541f0a3e7e209f23b60cf` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:55:33.189212 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46ead312aa541f0a3e7e209f23b60cf)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:55:33.191473 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:55:33.380495 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:55:33.383473 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46ead312aa541f0a3e7e209f23b60cf', 'request_id': 'req-e90cccbd-9679-4730-92d2-d24be141afb3'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:33.389783 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46ead312aa541f0a3e7e209f23b60cf', 'request_id': 'req-e90cccbd-9679-4730-92d2-d24be141afb3'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:33.397540 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46ead312aa541f0a3e7e209f23b60cf', 'request_id': 'req-e90cccbd-9679-4730-92d2-d24be141afb3'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:33.519672 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] The token cache is being invalidate because project b46ead312aa541f0a3e7e209f23b60cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:55:33.520019 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:33.520752 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:33.522610 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 625/1258] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Aug 23 16:55:33 2022] DELETE /identity/v3/projects/b46ead312aa541f0a3e7e209f23b60cf => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:55:33.526887 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:55:33.528414 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:55:33.542393 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165937c-71a2-4819-b73c-5c54de4f0c0f admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:55:33.609638 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:55:33.610491 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:55:33.610879 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:55:33.611255 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] PATH_INFO: `/v3/users/133a8adcdbef4df4bc61d112d153f79e` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:55:33.612616 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=133a8adcdbef4df4bc61d112d153f79e)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:55:33.614771 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:55:33.903684 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133a8adcdbef4df4bc61d112d153f79e'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:33.904432 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133a8adcdbef4df4bc61d112d153f79e'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:34.039298 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133a8adcdbef4df4bc61d112d153f79e'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:34.040793 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:55:34.054613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133a8adcdbef4df4bc61d112d153f79e'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:34.055550 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133a8adcdbef4df4bc61d112d153f79e'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:34.069904 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 634/1259] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Aug 23 16:55:33 2022] DELETE /identity/v3/users/133a8adcdbef4df4bc61d112d153f79e => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:55:34.484247 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:55:34.486312 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:55:34.506145 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cccbd-9679-4730-92d2-d24be141afb3 admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:55:34.590481 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:55:34.591402 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:55:34.591763 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:55:34.592133 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] PATH_INFO: `/v3/projects/140d25db83bd4acdaf13fe0b77448f76` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:55:34.594047 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=140d25db83bd4acdaf13fe0b77448f76)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:55:34.596914 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:55:34.776166 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140d25db83bd4acdaf13fe0b77448f76', 'request_id': 'req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:34.787647 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140d25db83bd4acdaf13fe0b77448f76', 'request_id': 'req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:34.796007 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140d25db83bd4acdaf13fe0b77448f76', 'request_id': 'req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:34.892971 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] The token cache is being invalidate because project 140d25db83bd4acdaf13fe0b77448f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:55:34.893257 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:34.893988 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:55:34.895633 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 626/1260] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Aug 23 16:55:34 2022] DELETE /identity/v3/projects/140d25db83bd4acdaf13fe0b77448f76 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:55:44.338430 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=11,keystone:DELETE=2 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:55:44.888984 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:DELETE=11,keystone:SELECT=63,keystone:INSERT=2 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:56:12.598973 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:56:12.600670 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:56:12.671333 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cd8ec-dedc-4375-97ea-f4f385d703b8 admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:56:12.732613 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51775e-38bb-4454-8907-e6d1063d0918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e4ab73defe45cb90e60e5719c5d0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:56:12.733241 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51775e-38bb-4454-8907-e6d1063d0918 service neutron] REQUEST_METHOD: `GET` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:56:12.733524 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51775e-38bb-4454-8907-e6d1063d0918 service neutron] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:56:12.733798 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51775e-38bb-4454-8907-e6d1063d0918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:56:12.735775 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-ce51775e-38bb-4454-8907-e6d1063d0918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:56:12.814172 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51775e-38bb-4454-8907-e6d1063d0918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:56:12.815698 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51775e-38bb-4454-8907-e6d1063d0918 service neutron] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:56:12.826910 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 635/1261] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 16:56:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:56:22.821774 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=70 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:56:23.279760 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:56:23.281987 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:56:23.303367 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c6cfc-4959-4bab-8b81-59ebe7af36e6 admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:56:23.309829 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:56:23.310712 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:56:23.311189 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:56:23.311592 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] PATH_INFO: `/v3/users/c0672efa012d46379c195c0460a0002f` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:56:23.331538 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0672efa012d46379c195c0460a0002f)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:56:23.332583 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: WARNING py.warnings [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:56:23.332583 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: warnings.warn(msg) Aug 23 16:56:23.332583 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: Aug 23 16:56:23.333831 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:56:23.568982 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0672efa012d46379c195c0460a0002f'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:23.569766 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0672efa012d46379c195c0460a0002f'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:23.586829 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0672efa012d46379c195c0460a0002f'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:23.587615 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0672efa012d46379c195c0460a0002f'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:23.611109 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0672efa012d46379c195c0460a0002f'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:23.703755 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 627/1262] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Aug 23 16:56:23 2022] DELETE /identity/v3/users/c0672efa012d46379c195c0460a0002f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:56:24.015595 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51775e-38bb-4454-8907-e6d1063d0918 service neutron] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:56:24.027032 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51775e-38bb-4454-8907-e6d1063d0918 service neutron] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:56:24.097923 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:56:24.098574 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:56:24.098858 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:56:24.099447 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] PATH_INFO: `/v3/projects/39aae0b85d144e1090b7a5de6b23be8f` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:56:24.115636 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39aae0b85d144e1090b7a5de6b23be8f)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:56:24.116699 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: WARNING py.warnings [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:56:24.116699 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: warnings.warn(msg) Aug 23 16:56:24.116699 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: Aug 23 16:56:24.117711 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:56:24.260113 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39aae0b85d144e1090b7a5de6b23be8f', 'request_id': 'req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:24.268542 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39aae0b85d144e1090b7a5de6b23be8f', 'request_id': 'req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:24.362621 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39aae0b85d144e1090b7a5de6b23be8f', 'request_id': 'req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:24.385301 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] The token cache is being invalidate because project 39aae0b85d144e1090b7a5de6b23be8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88349) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:56:24.385703 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:24.386314 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:24.387975 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 636/1263] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Aug 23 16:56:24 2022] DELETE /identity/v3/projects/39aae0b85d144e1090b7a5de6b23be8f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:56:24.392565 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:56:24.394098 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:56:24.408679 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf7c3b-729a-4605-a357-321deb63b3b5 admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:56:24.485238 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:56:24.486341 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:56:24.486792 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:56:24.487187 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] PATH_INFO: `/v3/users/cb65749e24e0448f8bf80f34a1fc0f87` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:56:24.507112 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb65749e24e0448f8bf80f34a1fc0f87)` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:56:24.509167 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:56:24.788104 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb65749e24e0448f8bf80f34a1fc0f87'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:24.788865 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb65749e24e0448f8bf80f34a1fc0f87'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:24.794109 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:56:24.797183 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb65749e24e0448f8bf80f34a1fc0f87'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:24.797947 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb65749e24e0448f8bf80f34a1fc0f87'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:24.812837 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.notifications [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb65749e24e0448f8bf80f34a1fc0f87'} {{(pid=88348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:24.979915 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 628/1264] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Aug 23 16:56:24 2022] DELETE /identity/v3/users/cb65749e24e0448f8bf80f34a1fc0f87 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:56:25.319990 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] Authenticating user token {{(pid=88349) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:56:25.319990 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.fernet_utils [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88349) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:56:25.338616 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba13f4-6e26-4ebc-b2e7-63aa5d11fb25 admin admin] Validating token access rules against request {{(pid=88349) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:56:25.418474 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b441ea8946b74edd833bbf63322f9350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f03f75490504c439981665b0cba53a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88349) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:56:25.419124 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:56:25.419436 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:56:25.419709 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7 admin admin] PATH_INFO: `/v3/projects/601044b54792473f8bd079c083669964` {{(pid=88349) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:56:25.438706 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=601044b54792473f8bd079c083669964)` {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:56:25.441960 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7 admin admin] RBAC: Authorization granted {{(pid=88349) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:56:25.461178 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:56:25.630500 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '601044b54792473f8bd079c083669964', 'request_id': 'req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:25.636792 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '601044b54792473f8bd079c083669964', 'request_id': 'req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:25.728409 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '601044b54792473f8bd079c083669964', 'request_id': 'req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7'} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:25.742567 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7 admin admin] The token cache is being invalidate because project 601044b54792473f8bd079c083669964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88349) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:56:25.746868 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:25.746868 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG keystone.notifications [None req-67dafdd2-43c7-4b5e-a7f1-a9fd21b9fcd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88349) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:56:25.746868 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: [pid: 88349|app: 0|req: 637/1265] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Aug 23 16:56:25 2022] DELETE /identity/v3/projects/601044b54792473f8bd079c083669964 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:56:35.180234 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=10,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:56:35.940114 dv-osbrick-836057-5-ceph devstack@keystone.service[88349]: DEBUG dbcounter [-] [88349] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:00:09.677743 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] Authenticating user token {{(pid=88348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 17:00:09.679270 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 17:00:09.824153 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93427817-23af-4bad-93da-50c202fb4575 admin admin] Validating token access rules against request {{(pid=88348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 17:00:09.887523 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6343c5e-79df-4cb5-94d6-c6cb3a6b5553 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef56a81a66744b2a3e468b7f182f9ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947f199ed73148beb3a4ecbc82cded19', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 17:00:09.888053 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6343c5e-79df-4cb5-94d6-c6cb3a6b5553 service placement] REQUEST_METHOD: `GET` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 17:00:09.888330 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6343c5e-79df-4cb5-94d6-c6cb3a6b5553 service placement] SCRIPT_NAME: `/identity` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 17:00:09.888679 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6343c5e-79df-4cb5-94d6-c6cb3a6b5553 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 17:00:09.890370 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.fernet_utils [None req-e6343c5e-79df-4cb5-94d6-c6cb3a6b5553 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 17:00:09.901883 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6343c5e-79df-4cb5-94d6-c6cb3a6b5553 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 17:00:09.903509 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6343c5e-79df-4cb5-94d6-c6cb3a6b5553 service placement] RBAC: Authorization granted {{(pid=88348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 17:00:09.914218 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: [pid: 88348|app: 0|req: 629/1266] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Aug 23 17:00:09 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 17:00:19.909459 dv-osbrick-836057-5-ceph devstack@keystone.service[88348]: DEBUG dbcounter [-] [88348] Writing DB stats keystone:SELECT=84 {{(pid=88348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}